12,120 questions with Azure Data Factory tags

Sort by: Updated
1 answer

Refund for student who well accidentally putted a DB trying to learn azure and ended up configuring an Hyper scale that seems it bills a lot per minute just for staying there

I was trying to learn some DB principles in Azure Cloud storage in my free time as a college student in Colombia , the idea I saw most clouds offers like 200 in bills which due to inexperience you do not know how much that is so I set up a database and a…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-09T12:34:39.1433333+00:00
Asperjasp 0 Reputation points
answered 2026-04-09T12:35:00.7866667+00:00
Q&A Assist
1 answer

Roles required for ADF in Azure portal

what ADF roles are needed in Azure to run a hybrid worker job for the onprem execution of a .bat file?

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-09T08:46:34.4666667+00:00
Kevin Burke 0 Reputation points
answered 2026-04-09T08:46:56.51+00:00
Q&A Assist
1 answer

ADF - Salesforce Linked Service - difference between SalesforceV2 & SalesforceServiceCloudV2

Hello, In ADF when choosing Salesforce data store there are two options : SalesforceV2 & SalesforceServiceCloudV2. Currently we built our ADF pipeline using the SalesforceV2. I am under the impression that the SalesforceV2 is for general objects,…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-09T05:34:37.79+00:00
Fatehah L 30 Reputation points
commented 2026-04-09T06:09:45.82+00:00
SAI JAGADEESH KUDIPUDI 1,750 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

We came across continues bad request error code, detail shows - Operation on target UntilCheckApprovalRequest failed: Activity timed out.

We came across continues bad request error code, detail shows - Operation on target UntilCheckApprovalRequest failed: Activity timed out.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-01T06:47:58.0733333+00:00
Na Li 20 Reputation points Microsoft Employee
accepted 2026-04-09T04:02:13.6966667+00:00
Na Li 20 Reputation points Microsoft Employee
2 answers

Looking for ADF to connect on-prem SQL server. Need help or suggestions

Hello Cloud Gurus, I have a required in setting up the On-prem SQL server connectivity through ADF for the DB migration project. Please share as i am looking for the instructions on the pre-requisites to setup on this and a detailed notes if any. Do I…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-01T15:30:40.43+00:00
Althaf Hussain Shaik 0 Reputation points
commented 2026-04-08T18:06:44.0133333+00:00
SAI JAGADEESH KUDIPUDI 1,750 Reputation points Microsoft External Staff Moderator
1 answer

Connection Timeouts to azure postgresql database

We’re encountering errors in our ADF pipelines when attempting to connect to the Azure PostgreSQL database. At the time, we were running 20 child pipelines concurrently. We can provide you the end point.   Error code 2100 Failure type User…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-07T13:46:40.1733333+00:00
Bobby John 60 Reputation points
edited the question 2026-04-08T04:14:03.94+00:00
Smaran Thoomu 34,880 Reputation points Microsoft External Staff Moderator
2 answers

ErrorCode=SftpPermissionDenied using copy activity in ADF

I'm trying to migrate data from File server to ADLS. All the access permissions has been granted for my id. but there are some restricted files due to which pipeline is getting failed. Is there are any way we can setup a pipeline where we can ignore…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-06T13:18:57.3233333+00:00
Bhupinder Singh 0 Reputation points
commented 2026-04-07T19:04:07.33+00:00
Manoj Kumar Boyini 11,600 Reputation points Microsoft External Staff Moderator
1 answer

Multiple pipelines using ADF custom activity failing due to InvalidXmlNodeValue error

I have multiple pipelines that use ADF Custom Activity with a Batch Account, and they normally run successfully. However, they have been failing consistently for the past 3 days with the error: “The value for one of the XML nodes is not in the correct…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-07T09:16:17.2+00:00
Alankritha C H 0 Reputation points Microsoft Employee
answered 2026-04-07T15:10:12.9966667+00:00
Amira Bedhiafi 41,131 Reputation points Volunteer Moderator
3 answers

Unable to authenticate my local folder to cloud server

Hi Azure Team, I am unable to connect local folder from my machine to azure cloud with file system linked service and SHIR I have cd "C:\Program Files\Microsoft Integration Runtime\5.0\Shared" and .\dmgcmd.exe -DisableLocalFolderPathValidation…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-05T07:54:11.0933333+00:00
trupti bedre 0 Reputation points
commented 2026-04-07T09:54:25.2766667+00:00
Pilladi Padma Sai Manisha 6,580 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Cannot get data from azure data lake gen2 Common Data Model

Hello, I tried to export data from my data lake storage with a dataflow in Azure Data Factory, the data structure seems good and I have the lines but I don't have any data appearing in the fields: I have tried with the scheme derivation and without it,…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-03-31T14:44:22.3833333+00:00
OUADAH Djilali 25 Reputation points
accepted 2026-04-07T09:46:09.7+00:00
OUADAH Djilali 25 Reputation points
2 answers One of the answers was accepted by the question author.

Azure Data Factory-Private Connectivity

Can ADF worskapce be made private as like Databricks workspace. If used without VPN should throw error. How to confirm private connectivity of ADF. Linked service test connection which uses SHIR is successful without VPN. DNS resolution of ADF portal is…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-03T08:03:47.91+00:00
Shubhangi Nannware 80 Reputation points
accepted 2026-04-06T07:49:29.8566667+00:00
Shubhangi Nannware 80 Reputation points
6 answers

How to fix Sharepoint ErrorCode=HttpRequestFailedWithUnauthorizedError, Unauthorized, usually this is caused by invalid credentials, while downloading data from sharepoint online to blob using ADF

Hi Everyone Hope your doing good. Iam facing an issue while downloading files from sharepoint online using ADF.. for this process I registred app in azure and then grant the application access to the sharepoint online site ..after this i created pipeline…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2023-10-12T08:10:39.31+00:00
Prashant Joshi 0 Reputation points
commented 2026-04-03T15:41:04.2966667+00:00
Viswa Prasad Pullela 0 Reputation points
2 answers

- descriptionOfIssue: We upgraded from Azure Data Factory Linked Service Oracle v1 to Oracle v2 due to v1 deprecating on 3/31/2026. We are seeing intermittent ORA-12650: No common encryption or data integrity algorithm errors. If we retry the pipeline, it

descriptionOfIssue: We upgraded from Azure Data Factory Linked Service Oracle v1 to Oracle v2 due to v1 deprecating on 3/31/2026. We are seeing intermittent ORA-12650: No common encryption or data integrity algorithm errors. If we retry the pipeline,…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-03T01:27:00.1466667+00:00
rajesh kumar 25 Reputation points
answered 2026-04-03T08:08:23.9533333+00:00
Smaran Thoomu 34,880 Reputation points Microsoft External Staff Moderator
3 answers

Locating the pipeline environment parameter setting?

How do I locate the pipeline environment parameter setting?

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-03-30T15:26:10.8533333+00:00
Kessler Kelly 0 Reputation points
answered 2026-04-03T07:24:59.8233333+00:00
Smaran Thoomu 34,880 Reputation points Microsoft External Staff Moderator
2 answers

Oracle V2 Connector Datatype Error

I migrated to the Oracle V2 connector. My pipelines are failing as I'm receiving the following error message for several fields for each table on the source side.  …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-01T16:20:48.9366667+00:00
Anic, Benjamin 0 Reputation points
commented 2026-04-02T22:48:02.6366667+00:00
Pilladi Padma Sai Manisha 6,580 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Is there way to create dataset on multiple tables together?

I have a question for Azure Data Factory. I am trying to create datasets for 50 tables in VM SQL database and moving data into each corresponding 50 tables Azure SQL database. On the process of creating datasets, is there way to select possibly all…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-03-24T20:50:26.7133333+00:00
Justin Doh 1,000 Reputation points
accepted 2026-04-01T23:01:40.5766667+00:00
Justin Doh 1,000 Reputation points
3 answers One of the answers was accepted by the question author.

Why does Azure Data Factory take ~20 seconds to execute a simple query that runs in milliseconds in MySQL?

Why does Azure Data Factory take ~20 seconds to execute a simple query that runs in milliseconds in MySQL? I have a pipeline that executes a simple update/lookup query on Azure MySQL. The query itself takes less than 1 second, but the pipeline activity…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-03-31T03:30:18.9366667+00:00
Kien Ngo 40 Reputation points
commented 2026-04-01T16:24:18.2533333+00:00
SAI JAGADEESH KUDIPUDI 1,750 Reputation points Microsoft External Staff Moderator
2 answers

ODBC connection errors from Data Factory

I have some Data Factory pipelines that have been running fine for years. Today, (4/1) I started to get this error message: ERROR [IM002] [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified I traced it back to the…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-04-01T14:28:35.53+00:00
Jeff Geitz 0 Reputation points
answered 2026-04-01T15:38:15.1333333+00:00
Manoj Kumar Boyini 11,600 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Analyze the message log of an activity running in the ADF pipeline.

Message from gateway host 15dbf5f0-513d-4284-bda5- Retrieving 52ea5cc34174. worker: c1799ef9-d34a-4442-b353- ce65ee2f3693、ProcessID 10868 Activity ID: 15dbf5f0-513d-4284-bda5-52ea5cc34174 IsSecondary False, StartPullTaskHA continues on condition: task is…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-03-31T06:47:38.0066667+00:00
Kien Ngo 40 Reputation points
commented 2026-03-31T22:29:41.34+00:00
Pilladi Padma Sai Manisha 6,580 Reputation points Microsoft External Staff Moderator
2 answers

ADF pipeline copy from one adf to another adf

Hi Team, Can someone help me to share the steps copy pipeline from one adf to another adf. Regards Saim

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,120 questions
asked 2026-03-27T19:46:28.2966667+00:00
shamim 0 Reputation points
commented 2026-03-31T21:22:40.02+00:00
Pilladi Padma Sai Manisha 6,580 Reputation points Microsoft External Staff Moderator