An Azure service for ingesting, preparing, and transforming data at scale.
Refund for student who well accidentally putted a DB trying to learn azure and ended up configuring an Hyper scale that seems it bills a lot per minute just for staying there
I was trying to learn some DB principles in Azure Cloud storage in my free time as a college student in Colombia , the idea I saw most clouds offers like 200 in bills which due to inexperience you do not know how much that is so I set up a database and a…
Azure Data Factory
Roles required for ADF in Azure portal
what ADF roles are needed in Azure to run a hybrid worker job for the onprem execution of a .bat file?
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF - Salesforce Linked Service - difference between SalesforceV2 & SalesforceServiceCloudV2
Hello, In ADF when choosing Salesforce data store there are two options : SalesforceV2 & SalesforceServiceCloudV2. Currently we built our ADF pipeline using the SalesforceV2. I am under the impression that the SalesforceV2 is for general objects,…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
We came across continues bad request error code, detail shows - Operation on target UntilCheckApprovalRequest failed: Activity timed out.
We came across continues bad request error code, detail shows - Operation on target UntilCheckApprovalRequest failed: Activity timed out.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Looking for ADF to connect on-prem SQL server. Need help or suggestions
Hello Cloud Gurus, I have a required in setting up the On-prem SQL server connectivity through ADF for the DB migration project. Please share as i am looking for the instructions on the pre-requisites to setup on this and a detailed notes if any. Do I…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Connection Timeouts to azure postgresql database
We’re encountering errors in our ADF pipelines when attempting to connect to the Azure PostgreSQL database. At the time, we were running 20 child pipelines concurrently. We can provide you the end point. Error code 2100 Failure type User…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ErrorCode=SftpPermissionDenied using copy activity in ADF
I'm trying to migrate data from File server to ADLS. All the access permissions has been granted for my id. but there are some restricted files due to which pipeline is getting failed. Is there are any way we can setup a pipeline where we can ignore…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Multiple pipelines using ADF custom activity failing due to InvalidXmlNodeValue error
I have multiple pipelines that use ADF Custom Activity with a Batch Account, and they normally run successfully. However, they have been failing consistently for the past 3 days with the error: “The value for one of the XML nodes is not in the correct…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Unable to authenticate my local folder to cloud server
Hi Azure Team, I am unable to connect local folder from my machine to azure cloud with file system linked service and SHIR I have cd "C:\Program Files\Microsoft Integration Runtime\5.0\Shared" and .\dmgcmd.exe -DisableLocalFolderPathValidation…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Cannot get data from azure data lake gen2 Common Data Model
Hello, I tried to export data from my data lake storage with a dataflow in Azure Data Factory, the data structure seems good and I have the lines but I don't have any data appearing in the fields: I have tried with the scheme derivation and without it,…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory-Private Connectivity
Can ADF worskapce be made private as like Databricks workspace. If used without VPN should throw error. How to confirm private connectivity of ADF. Linked service test connection which uses SHIR is successful without VPN. DNS resolution of ADF portal is…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to fix Sharepoint ErrorCode=HttpRequestFailedWithUnauthorizedError, Unauthorized, usually this is caused by invalid credentials, while downloading data from sharepoint online to blob using ADF
Hi Everyone Hope your doing good. Iam facing an issue while downloading files from sharepoint online using ADF.. for this process I registred app in azure and then grant the application access to the sharepoint online site ..after this i created pipeline…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
- descriptionOfIssue: We upgraded from Azure Data Factory Linked Service Oracle v1 to Oracle v2 due to v1 deprecating on 3/31/2026. We are seeing intermittent ORA-12650: No common encryption or data integrity algorithm errors. If we retry the pipeline, it
descriptionOfIssue: We upgraded from Azure Data Factory Linked Service Oracle v1 to Oracle v2 due to v1 deprecating on 3/31/2026. We are seeing intermittent ORA-12650: No common encryption or data integrity algorithm errors. If we retry the pipeline,…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Locating the pipeline environment parameter setting?
How do I locate the pipeline environment parameter setting?
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Oracle V2 Connector Datatype Error
I migrated to the Oracle V2 connector. My pipelines are failing as I'm receiving the following error message for several fields for each table on the source side. …
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Is there way to create dataset on multiple tables together?
I have a question for Azure Data Factory. I am trying to create datasets for 50 tables in VM SQL database and moving data into each corresponding 50 tables Azure SQL database. On the process of creating datasets, is there way to select possibly all…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Why does Azure Data Factory take ~20 seconds to execute a simple query that runs in milliseconds in MySQL?
Why does Azure Data Factory take ~20 seconds to execute a simple query that runs in milliseconds in MySQL? I have a pipeline that executes a simple update/lookup query on Azure MySQL. The query itself takes less than 1 second, but the pipeline activity…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ODBC connection errors from Data Factory
I have some Data Factory pipelines that have been running fine for years. Today, (4/1) I started to get this error message: ERROR [IM002] [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified I traced it back to the…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Analyze the message log of an activity running in the ADF pipeline.
Message from gateway host 15dbf5f0-513d-4284-bda5- Retrieving 52ea5cc34174. worker: c1799ef9-d34a-4442-b353- ce65ee2f3693、ProcessID 10868 Activity ID: 15dbf5f0-513d-4284-bda5-52ea5cc34174 IsSecondary False, StartPullTaskHA continues on condition: task is…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF pipeline copy from one adf to another adf
Hi Team, Can someone help me to share the steps copy pipeline from one adf to another adf. Regards Saim
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.