Azure Data Factory Connection
This article describes how to connect to Azure Data Factory (ADF) for lineage extraction.
See also Azure Data Factory Lineage Scanner.
Prerequisites
-
Review how sources and connections work.
-
Create a source to add this connection to.
-
An Azure service principal (app registration) with the Data Factory Contributor role assigned at the appropriate scope. For details, see Azure Data Factory permissions.
Add a connection
-
Go to [your source] > Connections and select Add Connection.
-
In Connection type, select Azure Data Factory.
-
Fill in the following:
-
Name: A meaningful name for your connection. Used to indicate the location of catalog items.
-
Description (Optional): A short description of the connection.
-
Subscription ID: The ID of the Azure subscription that contains the data factories you want to scan.
This appears as a GUID (for example,
12345678-1234-1234-1234-123456789012) and is found in the Azure portal in Subscriptions > [subscription name] > Overview.For more details, see Find your Azure subscription in the Microsoft documentation.
-
Add credentials
| Only Entra ID authentication is currently supported. |
-
Select Add Credentials.
-
Fill in the following:
-
Name: Provide a clear name for this set of credentials.
-
Description (Optional): Explain what the credentials are used for or provide other useful information.
-
Client ID: The application (client) ID registered in the Microsoft Entra portal.
This appears as a GUID (for example,
4701c7e7-1178-4006-a1fc-b4c3ee5cfef7) and is found in the Entra ID portal in App registrations > [app name] > Overview. -
Client Secret: The secret value generated for the application in the Microsoft Entra portal (App registrations > [app name] > Certificates & secrets).
Client secrets expire (maximum 24 months). Plan to renew them before expiration to avoid connection failures. -
Tenant ID: The directory (tenant) ID of your Microsoft Entra instance.
This appears as a GUID (for example,
12345678-1234-1234-1234-123456789012) and is found in the Entra ID portal in App registrations > [app name] > Overview, or in Azure Active Directory > Overview.For details about registering an application and generating credentials, see Register an application with Microsoft Entra ID.
-
-
To use this set of credentials by default when connecting to the data source, select Assign as default.
| Always use the dedicated credential fields for authentication details such as passwords, secrets, and tokens. This ensures credentials are handled with the appropriate level of protection and reliably preserved across environments. |
| One set of credentials must be defined as default for each connection. Otherwise, DQ evaluation fails and previewing data in the catalog is not possible. |
Was this page useful?