If you can't find the product or version you're looking for, visit support.ataccama.com/downloads

Configure Documentation Flow

You can configure which automatic actions are performed by each documentation flow option (Import, Discover, Document), or create a custom one.

How documentation flows work?

The documentation flows are optimized to deliver you the most important information as quickly as possible. To achieve this, assets are handled with different priorities depending on a set of predefined criteria.

The relevancy of each asset is decided based on the following conditions and in the following order:

Out of the default documentation flows, only the Document flow configuration has these configuration properties defined.

Catalog items whose metadata contains at least one value from the reference list provided are fully profiled. Such assets are fully profiled before sample profiling of other assets starts.

If there are no matches, the asset is processed using sample profiling instead, unless its type is defined in the fullProfileOnly condition. For example, in the default Document flow configuration, file catalog items can only be fully profiled.
Catalog items with at least one glossary term applied are fully profiled. Higher priority is given to catalog items whose total number of unique glossary terms is equal or greater than a specific number provided in the configuration.

By default, full profiling first runs on assets with at least two unique glossary terms.
Whether DQ evaluation is performed on a catalog item depends on the number of unique glossary terms linked to a DQ rule that are applied to that asset. Higher priority is assigned to assets with two or more such glossary terms.

By default, if an asset has at least one glossary term with an associated DQ rule, DQ evaluation is automatically initiated after full profiling.

View documentation flow settings

To view the documentation flow settings, go to Global Settings > Documentation Flow.

For each flow, the following information is shown:

Name: The name of the flow.
Order: The order in which the option is shown in the Documentatation Flow menu.
Configuration: The documentation flow settings, that is, which actions are automatically performed on the data and the conditions under which they are initiated.

Create a new documentation flow

To create a new documentation flow:

In Global Settings > Documentation flow, select Create.

Provide the following information:

Name: A unique name for the documentation flow.
Description: A description of the documentation flow and when to use it.
Order: The position at which the flow is displayed in the Documentation Flow menu.

Configuration: A list of actions that are performed within the flow and the associated conditions. The following actions are available: IMPORT`,SAMPLE_PROFILING,PROFILING,DQ,ANOMALY_DETECTION.

Use the Document flow configuration as a template for your new documentation flow.

The conditions are determined by the following properties:

referenceList: A list of terms used to determine the priority level of a catalog item when running full profiling. Terms are matched against catalog item and attribute names and are not case sensitive.
profilingTermCountThreshold: The minimum number of glossary terms that need to be applied to a catalog item so that catalog item is fully profiled when running a documentation flow.
profilingTermCountHighPriorityThreshold: The minimum number of glossary terms required on a catalog item so that the catalog item is given higher priority during full profiling in a documentation flow.
dqEvalTermCountThreshold: The minimum number of glossary terms with associated DQ rules that a catalog item needs to have applied so that DQ evaluation is performed on the catalog item after full profiling.
dqEvalTermCountHighPriorityThreshold: The minimum number of glossary terms with associated DQ rules that a catalog item needs to have applied so that the catalog item is given higher priority when running DQ evaluation in a documentation flow.

fullProfileOnly: The type of catalog items on which only full profiling can be performed (for example, fileCatalogItem).

For more information, see How documentation flows work?.

The Configuration field is a blank text field, without any input validation while the configuration needs to be provided in JSON format. Make sure there are no errors in the syntax, otherwise the flow fails.

Select Save and publish your changes to have the flow displayed in the Documentation Flow menu.

Edit documentation flow

To edit the configuration of an existing documentation flow, in Global Settings > Documentation flow, open the required configuration and in the three dots menu select Edit.

Update the configuration as needed: see Create a new documentation flow for details about the options available. Next, select Save and publish your changes.

Delete documentation flow

To delete a documentation flow, in Global Settings > Documentation flow, open the required configuration and in the three dots menu select Delete. Alternatively, select one or more flows from the listing and in the ribbon that appears select Delete.

Confirm your choice when prompted and publish your changes.

Was this page useful?