Lineage
Ataccama Lineage allow you to effectively capture and analyze data lineage across a number of different data systems. Use lineage to understand the flow of data across your systems and improve your data governance, compliance, and quality practices.
What is data lineage?
Data lineage refers to the ability to trace and visualize the flow of data as it moves from its source to its destination, including transformations it undergoes along the way.
Its main use cases are:
- Data quality root cause analysis
-
Lineage helps you find answers to questions such as How does the quality of my data change during the data flow? and Where do DQ issues in my data come from?.
- Data discovery
-
Lineage lets you explore your data sources and flows, providing you with both technical and business understanding of your data. With lineage, you can find out how your data was calculated, whether it comes from a trusted source, or whether a particular report includes sensitive data.
- Regulatory and audit trail
-
Lineage can help you stay on track with your regulatory and audit requirements as it provides insights into the origins of data and how your reports were exactly calculated.
How lineage works
Ataccama Lineage is powered by Ataccama ONE lineage scanners, which are modules responsible for scanning the sources and producing structured lineage metadata. The exported metadata is then imported into ONE, where you can visualize your data and explore the connections between data assets.
In addition, you can use the MANTA lineage scanner to extract metadata from MANTA and import it to ONE or upload a custom lineage file.
Ataccama ONE lineage scanner has two deployment options:
-
As a standalone component: Available as an independent application managed separately from Ataccama ONE. Distributed as a Docker Compose image.
The application produces lineage metadata that can be manually uploaded to any version of Ataccama ONE starting from v14 LTS. See Standalone Lineage Scanner.
-
Built-in scanner: Available from version 16.0.0, the lineage scanner is available as a built-in module of Ataccama ONE using a service called Lineage Scanning Service (LSS).
With Lineage Scanner Service, you first configure and run scan plans in ONE, which determine what data is extracted from which source. After this, you can load scan results directly to ONE. See Built-In Lineage Scanner.
The following table which scanner option can be deployed depending on the version of Ataccama ONE and the platform deployment type.
| Using edge processing (that is, hybrid deployment mode) is not supported in the current version. |
| Version | Ataccama Cloud with direct access to sources | On-premise and self-managed | Ataccama Cloud with edge processing |
|---|---|---|---|
v14 LTS |
Standalone |
Standalone |
Standalone |
v15 LTS |
Standalone |
Standalone |
Standalone |
v16 |
Built-in |
Standalone |
Standalone |
Was this page useful?