azure-synapse-analytics

name	azure-synapse-analytics
description	Expert knowledge for Azure Synapse Analytics development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Synapse SQL pools, serverless SQL, Spark pools, Synapse Link, or PolyBase/ELT data loading, and other Azure Synapse Analytics related development tasks. Not for Azure Data Factory (use azure-data-factory), Azure Data Explorer (use azure-data-explorer), Azure HDInsight (use azure-hdinsight), Azure Databricks (use azure-databricks).
compatibility	Requires network access. Uses mcp_microsoftdocs:microsoft_docs_fetch or fetch_webpage to retrieve documentation.
metadata	{"generated_at":"2026-08-09","generator":"docs2skills/1.0.0"}

Azure Synapse Analytics Skill

This skill provides expert guidance for Azure Synapse Analytics. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

• Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
• Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

Category	Lines	Description
Troubleshooting	L37-L66	Diagnosing and fixing Synapse workspace, SQL pool, Spark, Studio, and Synapse Link errors, including connectivity, performance, workload classification, and known issues/workarounds.
Best Practices	L67-L128	Best practices for Synapse performance, SQL/T-SQL patterns, Spark optimization, indexing/statistics, data loading, and migrating/modernizing from Netezza, Oracle, and Teradata.
Decision Making	L129-L151	Guidance for choosing Synapse components, sizing and cost models, and planning/migrating data warehouses (Netezza, Oracle, Teradata, SQL DW) and Spark runtimes for optimal architectures.
Architecture & Design Patterns	L152-L171	Architecture and design guidance for Synapse workspaces, SQL/serverless/Spark pools, data warehouse migrations, table/distribution/partition strategies, ELT/PolyBase loading, and workload management.
Limits & Quotas	L172-L181	Synapse SQL and Synapse Link limits: memory/concurrency caps, capacity and quotas, Delta Lake v1 query limits, and feature/known issues for Cosmos DB and SQL Link integrations.
Security	L182-L242	Securing Synapse workspaces end-to-end: auth and RBAC, network and private endpoints, firewall and data exfiltration, encryption/TDE, policies, managed identities, and secure data access/migration.
Configuration	L243-L291	Configuring Synapse workspaces, Spark pools, libraries, monitoring/metrics, backups/restore, workload management, and integrations with Purview, Azure ML, and Azure Monitor.
Integrations & Coding Patterns	L292-L341	Integrating Synapse with Spark, SQL, ML, storage, Cosmos DB, and external tools; patterns for data movement, querying files, logging/metrics, and managing compute via APIs and automation.
Deployment	L342-L349	Guides for deploying Synapse workspaces and dedicated SQL pools with CI/CD and ARM templates, plus operational readiness checks and configuring SQL pool maintenance windows.

Troubleshooting

Topic	URL
Recover Synapse workspaces after Entra tenant move	https://learn.microsoft.com/en-us/azure/synapse-analytics/how-to-recover-workspace-after-tenant-move
Known issues and workarounds for Azure Synapse Analytics	https://learn.microsoft.com/en-us/azure/synapse-analytics/known-issues
Resolve compatibility issues between SQL Server apps and Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/partner/compatibility-issues
Diagnose and resolve Livy job errors in Synapse Spark	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-handle-livy-error
Debug Synapse Spark apps with extended history server	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-history-server
Troubleshoot Synapse Spark library installation failures	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-troubleshoot-library-errors
Monitor query activity and resource utilization in Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/sql-data-warehouse-concept-resource-utilization-query-activity
Identify queries exceeding workload group timeouts	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/sql-data-warehouse-how-to-find-queries-running-beyond-wlm-elapsed-timeout
Monitor and adjust workload importance in Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/sql-data-warehouse-how-to-manage-and-monitor-workload-importance

Best Practices

Topic	URL
Configure Git source control for Synapse Studio	https://learn.microsoft.com/en-us/azure/synapse-analytics/cicd/source-control
Apply design and performance best practices for Netezza to Synapse migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/netezza/1-design-performance-migration
Plan ETL and data load for Netezza to Synapse migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/netezza/2-etl-load-migration-considerations
Implement visualization and reporting after Netezza to Synapse migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/netezza/4-visualization-reporting
Minimize SQL compatibility issues in Netezza to Synapse migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/netezza/5-minimize-sql-issues
Apply design and performance best practices for Oracle to Synapse migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/oracle/1-design-performance-migration
Plan ETL and data load for Oracle to Synapse migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/oracle/2-etl-load-migration-considerations
Implement visualization and reporting after Oracle to Synapse migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/oracle/4-visualization-reporting
Minimize SQL compatibility issues in Oracle to Synapse migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/oracle/5-minimize-sql-issues

Decision Making

Topic	URL
Compare Synapse data integration with Azure Data Factory	https://learn.microsoft.com/en-us/azure/synapse-analytics/data-integration/concepts-data-factory-differences
Assess environment to choose Synapse technologies	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-assess-environment
Review Synapse project plan for implementation success	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-evaluate-project-plan
Plan and execute migration to Synapse dedicated SQL pool	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/migrate-to-synapse-analytics-guide
Select tools for Netezza data warehouse migration to Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/netezza/6-microsoft-third-party-migration-tools
Select tools for Oracle data warehouse migration to Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/oracle/6-microsoft-third-party-migration-tools
Choose Microsoft and third-party tools for Teradata to Synapse migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/teradata/6-microsoft-third-party-migration-tools
Plan and manage Azure Synapse Analytics costs	https://learn.microsoft.com/en-us/azure/synapse-analytics/plan-manage-costs
Plan migration from Azure Synapse Spark 3.4 runtime	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-34-runtime

Architecture & Design Patterns

Topic	URL
Evaluate Synapse data integration architecture design	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-evaluate-data-integration-design
Evaluate dedicated SQL pool data warehouse design	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-evaluate-dedicated-sql-pool-design
Evaluate serverless SQL pool architecture and design	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-evaluate-serverless-sql-pool-design
Evaluate Apache Spark pool design in Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-evaluate-spark-pool-design
Evaluate Azure Synapse workspace architecture design	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-evaluate-workspace-design
Success by Design architecture guidance for Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/success-by-design-introduction
Design a modern Azure data warehouse after Netezza migration	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/netezza/7-beyond-data-warehouse-migration
Design a modern data warehouse after Teradata migration to Azure	https://learn.microsoft.com/en-us/azure/synapse-analytics/migration-guides/teradata/7-beyond-data-warehouse-migration
Design ELT-based data loading patterns for Synapse dedicated SQL pools	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/design-elt-data-loading

Limits & Quotas

Topic	URL
Understand memory and concurrency limits in Synapse SQL pool	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/memory-concurrency-limits
Dedicated SQL pool FAQ with service limits	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/sql-data-warehouse-overview-faq
Dedicated SQL pool capacity limits and quotas	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/sql-data-warehouse-service-capacity-limits
Query Delta Lake v1 with Synapse serverless SQL	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql/query-delta-lake-format
Supported features and limitations of Synapse Link for Cosmos DB	https://learn.microsoft.com/en-us/azure/synapse-analytics/synapse-link/concept-synapse-link-cosmos-db-support
Azure Synapse Link for SQL FAQs and limits	https://learn.microsoft.com/en-us/azure/synapse-analytics/synapse-link/faq

Security

Topic	URL
Access firewall-protected Purview from Synapse securely	https://learn.microsoft.com/en-us/azure/synapse-analytics/catalog-and-governance/how-to-access-secured-purview-account
Secure Synapse linked services with managed VNet	https://learn.microsoft.com/en-us/azure/synapse-analytics/data-integration/linked-service
Design and implement access control in Azure Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/security-white-paper-access-control
Implement authentication options for Azure Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/security-white-paper-authentication
Configure data protection features in Azure Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/security-white-paper-data-protection
Configure network security for Azure Synapse workspaces	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/security-white-paper-network-security
Use threat detection and auditing in Azure Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/security-white-paper-threat-protection
Browse ADLS Gen2 with ACLs in Synapse securely	https://learn.microsoft.com/en-us/azure/synapse-analytics/how-to-access-container-with-access-control-lists
Configure secure prerequisites for Foundry Tools in Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/machine-learning/tutorial-configure-cognitive-services-synapse

Configuration

Topic	URL
Connect Synapse workspace to Microsoft Purview	https://learn.microsoft.com/en-us/azure/synapse-analytics/catalog-and-governance/quickstart-connect-azure-purview
Design Synapse development, test, and production environments	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-evaluate-solution-development-environment-design
Configure and review monitoring for Azure Synapse	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-perform-monitoring-review
Link Synapse workspace to Azure Machine Learning	https://learn.microsoft.com/en-us/azure/synapse-analytics/machine-learning/quickstart-integrate-azure-machine-learning
Set up SynapseML environment for Foundry Tools	https://learn.microsoft.com/en-us/azure/synapse-analytics/machine-learning/setup-environment-cognitive-services
Reference monitoring metrics for Azure Synapse Analytics	https://learn.microsoft.com/en-us/azure/synapse-analytics/monitor-synapse-analytics-reference
Monitor Apache Spark applications in Synapse Studio	https://learn.microsoft.com/en-us/azure/synapse-analytics/monitoring/how-to-monitor-spark-applications
Runtime components for Synapse Spark 3.3	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-33-runtime
Runtime components for Synapse Spark 3.5	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-35-runtime

Integrations & Coding Patterns

Topic	URL
Access Synapse ADLS Gen2 data from Azure Machine Learning	https://learn.microsoft.com/en-us/azure/synapse-analytics/machine-learning/access-data-from-aml
Score ML models with PREDICT in Synapse Spark	https://learn.microsoft.com/en-us/azure/synapse-analytics/machine-learning/tutorial-score-model-predict-spark-pool
Use Delta Lake tables with Synapse Spark	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-delta-lake-overview
Manage Synapse Spark packages via PowerShell and REST	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-manage-packages-outside-ui
Emit Synapse Spark logs and metrics to Event Hubs	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/azure-synapse-diagnostic-emitters-azure-eventhub
Emit Synapse Spark logs and metrics to Azure Storage	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/azure-synapse-diagnostic-emitters-azure-storage
Collect Synapse Spark metrics via Prometheus APIs	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/connect-monitor-azure-synapse-spark-application-level-metrics
Use Spark CDM connector to read/write Common Data Model	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/data-sources/apache-spark-cdm-connector
Use Kusto connector with Synapse serverless Spark	https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/data-sources/apache-spark-kusto-connector

Deployment

Topic	URL
Implement CI/CD for Azure Synapse workspaces	https://learn.microsoft.com/en-us/azure/synapse-analytics/cicd/continuous-integration-delivery
Perform operational readiness review for Synapse deployment	https://learn.microsoft.com/en-us/azure/synapse-analytics/guidance/implementation-success-perform-operational-readiness-review
Deploy Synapse workspaces using ARM templates	https://learn.microsoft.com/en-us/azure/synapse-analytics/quickstart-deployment-template-workspaces
Plan and configure Synapse SQL pool maintenance windows	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/maintenance-scheduling
Set up CI/CD for Synapse dedicated SQL pools	https://learn.microsoft.com/en-us/azure/synapse-analytics/sql-data-warehouse/sql-data-warehouse-continuous-integration-and-deployment