User Community Service Desk Downloads
If you can't find the product or version you're looking for, visit support.ataccama.com/downloads

Invalid Samples

Invalid samples provide an opportunity to view specific records that fail the data quality (DQ) rules applied to the catalog item attributes. This allows you to investigate the issues in detail and speeds up the process of fixing the data.

You can access invalid samples from the catalog item Data Quality tab, provided that the invalid samples are enabled for this item.

To use this functionality, the invalid samples storage for catalog items must be configured by your admin on a global level. For more information, see Retention Settings, section Set retention period on invalid data samples.

Configure invalid samples

Configuration of invalid samples is available to the roles with Full and Editing access to the catalog item (Data Owner and Data Steward by default).

To configure the preview of invalid results samples on your catalog item:

  1. Select Set Invalid Samples.

    Select Set Invalid Samples
  2. In Invalid Samples configuration, do the following:

    1. Select Invalid samples enabled on Catalog item.

    2. Set the size of the sample per catalog item.

    3. Save the changes.

      Invalid samples configuration dialog
  3. Once invalid samples are enabled, Invalid sample results will be shown after the evaluation appears in the Data Quality section. After running data quality evaluation, this changes to Show invalid samples option.

    Show invalid samples

A sample of invalid records is available once DQ evaluation is run on the catalog item. Either wait for the next scheduled DQ evaluation run (recommended especially for larger data sets) or select Evaluate to run ad hoc evaluation. See Run DQ Evaluation.

If Invalid Samples are not turned on for a catalog item, they are not generated at all (that is, not saved).
Where are invalid samples saved?

If invalid samples are enabled, they are stored in the drillthrough bucket in ONE Object Storage.

You can define how long the samples should be stored for on a project basis or globally. Samples are deleted from the storage accordingly. For details, see Retention Settings.

View invalid samples

A preview of invalid samples is available to the roles with Full, Editing, and View data access to the catalog item (Data Owner and Data Steward by default).

To preview the invalid samples, select Show invalid samples:

Select Show invalid samples

A list of Invalid samples opens, where you can view records that failed DQ rules.

List of invalid samples

Here you can:

  • Select the attribute name to see the details.

  • Filter records to view invalid samples for specific rules, or to view only selected attributes.

    Filter list of invalid samples

Was this page useful?