Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,868 questions
0 answers
adf/synapse - how to copy all files based on given lastmodified date from source container and save in sink container in respective folder based on extension
Req: Copy files from one container and store in another container- I am specifying the last modified date , i want to copy files only before that last last modified date. The files are of any type. csv,xml,json,txt etc. Also, in source container my files…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 57.00000000000001%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EW%3C/text%3E%3C/svg%3E)
0 answers
How to configure use of access token and API key in a linked service
Authorization and x-api-key headers have been added to linked service for connection to C365 cloud service. Can't understand reason for error. Please help { "errorCode": "2200", "message": "Failure happened on 'Source'…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 84%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAC%3C/text%3E%3C/svg%3E)
1 answer
Unable to see all the lake database tables in synapse workspace
Hello, I am unable to see the Lake Database tables inside db blade on left side of synapse workspace, only few are visible but rest are not visible but I am able to see them through SSMS and also execute query on them. In fact, these tables are not…
asked 2024-09-17T15:34:39.9633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 50%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJO%3C/text%3E%3C/svg%3E)
Jaya Ojha
60
Reputation points
answered 2024-09-17T20:28:03.81+00:00
Amira Bedhiafi
23,251
Reputation points
1 answer
Struggling with error: Inserting value to batch for column type DATETIME2 failed.
We've been running queries on our serverless sql pool using OPENROWSET to read parquet files in an azure gen2 datalake. Yesterday, the queries started throwing this error: Inserting value to batch for column type DATETIME2 failed. No explicit changes…
asked 2024-09-17T14:57:12.8566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 14.000000000000002%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
Hepworth, Michael
0
Reputation points
answered 2024-09-17T20:21:48.7733333+00:00
Amira Bedhiafi
23,251
Reputation points
1 answer
Azure Synapse pipeline copy data activity from on-prem to Azure sql db issue
{ "errorCode": "2200", "message": "ErrorCode=SqlFailedToConnect,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Cannot connect to SQL Database. Please contact SQL server team for further…
asked 2024-09-17T17:23:29.7766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 97%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMC%3C/text%3E%3C/svg%3E)
Madhu Challapalli
20
Reputation points
edited the question 2024-09-17T19:40:23.3933333+00:00
Madhu Challapalli
20
Reputation points
1 answer
Job Queueing with Microsoft Fabric
Hi Team, We have a scenario where we need to move data from Oracle to One lake on demand. We are having a table where a user enters the configuration similar to batch and on each insert it needs to trigger the data movement pipelines .However I don't…
asked 2024-09-16T11:41:45.1066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 84%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENV%3C/text%3E%3C/svg%3E)
Nitya V
45
Reputation points
commented 2024-09-17T18:14:15.0433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
15,035
Reputation points Microsoft Vendor
1 answer
Error provisioning Microsoft.Azure.SynapseAnalytics workspace
Hi - I am getting the following error when trying to create a Synapse Analytics WS: {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for more…
asked 2024-09-13T15:57:47.77+00:00
babak hosseinzadeh
0
Reputation points
commented 2024-09-17T18:13:57.2433333+00:00
Smaran Thoomu
15,035
Reputation points Microsoft Vendor
1 answer
ADF Pipeline failing with an error saying column can be found
I have a pipeline that looks up a query to define the list of tables from source and usin for loop it should load data to Target Synapse pool but it is failing with following error on copy command.…
asked 2024-09-11T20:01:56.4766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 38%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJJ%3C/text%3E%3C/svg%3E)
Jiby Jacob
65
Reputation points
commented 2024-09-17T16:59:30.9933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
10,245
Reputation points Microsoft Vendor
0 answers
Azure SQL database restore to Synapse
we need to do restore sql server database from restore point to dedicated sql pool on synapse on same resource group we are trying to do restore azure sql server db on same restore group where we have synapse but it ends up with error ERROR1.JPG Command…
asked 2024-09-11T14:01:57.8966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 80%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
Andrea Galardi
0
Reputation points
commented 2024-09-17T16:00:43.2633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 34%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPM%3C/text%3E%3C/svg%3E)
Priv - Molly Vander Velde
0
Reputation points
2 answers
Apache slf4j error when setting up spark pool
I am getting the following errors when my apache spark pool job is running. The main issue seems to be the slf4j error. How do I fix this: Picked up _JAVA_OPTIONS: -Djava.io.tmpdir=/mnt/tmp Picked up _JAVA_OPTIONS: -Djava.io.tmpdir=/mnt/tmp SLF4J:…
asked 2024-09-02T09:32:31.5366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 21%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDP%3C/text%3E%3C/svg%3E)
Daniel Pearson
20
Reputation points
answered 2024-09-17T15:53:55.0166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 46%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENN%3C/text%3E%3C/svg%3E)
NIKHILA NETHIKUNTA
1,760
Reputation points Microsoft Vendor
1 answer
DATA_COMPRESSION = COLUMNSTORE_ARCHIVE not working for partitioned table
I created partition table(24 partition) with DISTRIBUTION = ROUND_ROBIN, CLUSTERED COLUMNSTORE INDEX . Table size was 300 GB but after DATA_COMPRESSION = COLUMNSTORE_ARCHIVE the size increased many folds(7-8 times).Does partitioned table archive is not…
asked 2024-09-13T07:33:21.6633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 94%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rajiv Kumar Tiwari
0
Reputation points
commented 2024-09-17T15:33:59.5833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT
30,891
Reputation points Microsoft Employee
1 answer
Synapse Notebook to Azure SQL Database connection issue
0 created Linked service to Azure SQL database in Synapse Analytics that uses Authentication type " System Assigned Managed Identity". Than referencing it in PySpark Notebook. Method getConnectionString is used to get access token. But its…
asked 2024-07-25T09:57:59.5966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(316.8, 82%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBS%3C/text%3E%3C/svg%3E)
Balbeer Singh
0
Reputation points
answered 2024-09-17T15:10:09.7533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 63%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHV%3C/text%3E%3C/svg%3E)
hijesh vl
11
Reputation points
1 answer
How to Set Up Automatic D365 Finance and Operations Data Replication to Azure Data Lake for Reporting?
Hi everyone, We have a D365 Finance and Operations environment hosted in the Central US region. Our Accounts Receivable (AR) data, including customers and invoices, is integrated from an on-premises Oracle database into D365 FinOps. I would like to…
asked 2024-09-04T14:06:33.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 95%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENP%3C/text%3E%3C/svg%3E)
Nitin Patil
20
Reputation points
commented 2024-09-17T13:46:59.9733333+00:00
phemanth
10,245
Reputation points Microsoft Vendor
0 answers
Assistance Needed: Dynamic Mapping of Salesforce Data to Dynamics 365 Business Central via Azure Data Factory.
I am working on mapping Salesforce (Account or Invoice table) data to Dynamics 365 Business Central using Azure Data Factory. Steps completed so far: Created Linked Service for Salesforce (Test connection successful). Created Linked Service for Business…
asked 2024-09-16T05:34:55.71+00:00
Vaibhav Patil
235
Reputation points
commented 2024-09-17T13:38:20.7333333+00:00
phemanth
10,245
Reputation points Microsoft Vendor
7 answers
Forbidden 403 when trying to create a delta table in oneLake with notebook using sql
Created a spark dataframe from the csv files and also created a view TableTempView on top of this dataframe. When I try to create a table in the lakehouse using below code %%sql create table if not EXISTS Bronze_Sales21 using DELTA as select * from…
asked 2024-08-13T06:46:10.3733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(160, 48%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Siva Reddy
40
Reputation points
answered 2024-09-17T08:35:32.6433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 83%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMW%3C/text%3E%3C/svg%3E)
Moś, Wojciech
0
Reputation points
1 answer
Creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory
Hi everyone, I’m working on creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory. Here are the steps I’ve taken so far: Copy Data: I’m using the Copy Data activity to get the data into a CSV file. Azure Blob…
asked 2024-09-16T18:30:01.1433333+00:00
Vaibhav Patil
235
Reputation points
commented 2024-09-17T07:51:43.7266667+00:00
Vaibhav Patil
235
Reputation points
1 answer
My dataflow activity failed in Synapse pipeline
Hello, I created a data flow pipeline composed of source to sink and each time it runs i get this error : how can i fix it ? I tried raising the number of partitions but it did not work Thank you {"message":"Job failed due to reason: at…
asked 2024-09-13T07:09:32.54+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 36%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWA%3C/text%3E%3C/svg%3E)
WAJIH Arfaoui
0
Reputation points
commented 2024-09-17T06:01:30.7266667+00:00
Vinodh247
18,271
Reputation points
1 answer
How can we identify static IP address for azure Synapse Integration Runtime pipeline for allowing connecting in SFTP Linked server?
Dear Team, We are trying to configure a linked server connection from azure synapse to SFTP server. We would like to restrict the IP address of Azure Synapse Integration Runtime in SFTP server . We are unable to get the IP Address of Synapse. Could you…
asked 2024-02-16T07:26:36.5333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 87%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
Harish Dharmavaram
0
Reputation points
edited a comment 2024-09-17T03:54:50.1466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 72%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Marcus Kyle
0
Reputation points
2 answers
One of the answers was accepted by the question author.
Can't create a datalake storage account Gen2 when creating an azure synapse resource
When trying to create a new data lake gen2 storage account (while creating a azure Synapse resource), I keep on getting an error message that the account name can't be verified and that I need to try again. I've waited for a couple of hours and have…
asked 2023-11-16T17:15:29.1633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 46%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EUF%3C/text%3E%3C/svg%3E)
u512353 (Fuentes Alfaro, Patricia)
25
Reputation points
commented 2024-09-16T21:17:31.1166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 64%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECC%3C/text%3E%3C/svg%3E)
Charles Chinedu Dike
0
Reputation points
2 answers
Error when using the CosmosDB Analytical Store for source queries in a Synapse ADF Dataflow
How can I resolve the error message I receive when using the CosmosDB Analytical Store as source queries in a Synapse ADF Dataflow? I created the source with Analytical Store selected as explained in this how-to link:…
asked 2024-09-06T10:59:31.9366667+00:00
Jude Moore
5
Reputation points
commented 2024-09-16T19:14:31.4433333+00:00
Smaran Thoomu
15,035
Reputation points Microsoft Vendor