User Community Service Desk Downloads
If you can't find the product or version you're looking for, visit support.ataccama.com/downloads

Ataccama 13.9.0 Release Notes

This page contains the release notes for version 13.9.0 of the Ataccama ONE Gen2 platform. Release information affecting all modules in the platform can be found first, and module specific information can be found in the corresponding ONE, MDM, and RDM sections.

Release Information

Products

ONE Data Governance, ONE Data Quality and Governance, ONE RDM, ONE MDM

Release date

2022-09-13

Downloads

support.ataccama.com/downloads/13.9.x

Security updates

Ataccama Security Advisories

ONE

Anomaly Detection Improvements (Irregular Timestamps)

Time-dependent anomaly detection within monitoring projects has been improved both in terms of capability and user interaction. The model can now detect irregular or missing timestamps and subsequently exclude them from the calculation or impute suitable values. This makes anomaly detection on time series more accurate. In addition, if no periodicity is specified, the system can derive it from the timestamps.

You now also need to specifically select to run time-dependent anomaly detection, whereas previously this was just assumed when periodicity was provided. Furthermore, you can either provide a periodicity value yourself or leave it to the system to derive it.

DQ Notifications Improvements

In addition to the existing notifications available on monitoring projects, from 13.9.0 it is possible to configure notifications for specific catalog items, groups, or rule instances, based on data quality thresholds you define. As well as the increased granularity, further improvements include being able to notify individual users (not just groups and roles), and being able to use filters within the notification configuration.

Both the existing general notifications (monitoring failed, critical error in structure, new results, DQ issue, or anomalies) and the custom notifications, will be listed in the monitoring projects Notifications tab. From there, you can edit, turn them off or on, or remove them as required.

DQ Rules Included in New Import and Export Capabilities

DQ rules can now be included in export plans and then imported into a new instance. For more information, see Import and Export.

Create Permissions Functionality Extended

In version 13.9 of ONE, we have extended the permissions functionality. Now you can configure the number of users with the create permissions, which allows non-admin users to create new assets in ONE. Create permissions let users create a new asset on the node page using the Create button. For users without the necessary permissions, the button is disabled.

ataccama 13.9.0 release notes create button

This way, you can separate assets for various groups and ensure that all users have the appropriate access rights. Consider the following when working with new create permissions:

  • When any user creates an asset, this user automatically becomes the owner of that asset and can then view and edit it. This applies to all users with any role that gives permission to create an asset.

  • A new Keycloak role MMM_creator is added. Users with this role can create assets of any type. Since this is an extension of the previous model, create capabilities of all other roles remain unchanged and valid. In other words, admin users can still use their existing permissions to create assets of the same type and they can still edit all assets.

  • The user who created an asset can then share it with any other user or role through the Access tab. Meanwhile, all the Viewer role capabilities remain unchanged and users with the super-viewer role can still see all assets.

The new functionality is turned off by default and must be manually enabled via the JSON configuration file. For more information, see user-access-management:manage-permissions-users-roles.adoc, section Configuring custom permissions.

For various MMM_creator role mapping example configurations, see user-access-management:configure-permissions-frequent-scenarios.adoc.

Since 13.9 the new full-text search is enabled on the whole application and is a good starting point for searching data entities and locating the area for the future detailed search if necessary. For more information, see Search. To learn how to configure Global Search, see full-text-search-configuration.adoc.

ataccama 13.9.0 release notes global search

AWS IAM Authentication for AWS resources

Amazon S3 bucket can now be accessed using AWS IAM roles.

This functionality is currently not available for Ataccama ONE PaaS.

New Lineage Schema

With the new MANTA lineage schema more data sources can be configured for lineage. MANTA-integrated lineage is now available not only for catalog items from Microsoft SQL and PostgreSQL but also for Oracle and Teradata sources.

The new schema must be defined in Data Processing Engine (DPE) configuration via plugin.manta-integration.ataccama.one.manta-integration.url-viewer-gui property before the 13.9 version runs for the first time. If the property is not configured, lineage data is unavailable. For more information, see configuration-reference:lineage-configuration.adoc.

Terms Suggestions Synchronization

In versions 13.8 and earlier, Term Suggestions and the Metadata Management Module (MMM) communicated using a term suggestions database, which needed to be configured. Since version 13.9, the connection is enabled via the new Api service and it is no longer necessary to configure the database connection. If you are upgrading from an earlier version, the Api service needs to be enabled for 13.9. For more information, see ONE Gen2 Upgrade Guide.

As the Term Suggestions services have improved in stability, it should not be necessary to initiate Term Suggestions synchronization when working with the application as usual. The only exception to this is when modifying the metadata model, for example, by restoring database from a snapshot or by importing any initial content (such as default or demo).

After restoring the database from a snapshot, Term Suggestions need to be synchronized on the Global Settings > Term Suggestions tab:

ataccama 13.9.0 release notes term suggestions synchronization

New Steps in ONE Desktop to Access DQ Results

The API changes resulting from the changes to DQ project and DQ catalog results storage meant that the ONE Metadata Reader step could no longer be used to access results. This release brings new steps that can be used in addition to the Metadata Reader step (or other inputs) to access DQ results:

  • DQ Attribute Aggregation Results: Returns results of certain DQ aggregations for attributes.

  • DQ Catalog Item Aggregation Results: Returns results of DQ aggregations for catalog item.

  • DQ Monitoring Project Aggregation Results: Returns results of certain aggregations (custom, catalog item level, attribute level).

  • DQ Monitoring Project Check Results: Returns results of certain DQ checks. Results also include explanations of invalidity.

  • DQ Monitoring Project Filter Values: Returns data values of filter attributes. These values can change in each processing.

  • DQ Monitoring Project Results: Returns project validity results aggregated over all catalog items in the monitoring project.

  • DQ Rule Instance Results: Returns results of DQ rule instances. Results also include explanations of invalidity.

  • DQ Term Aggregation Results: Returns aggregated DQ results for a whole term.

  • DQ Term Attribute Aggregation Results: Returns results of term aggregation for an attribute.

Updated getParameterValue Function in ONE Desktop

Starting from 13.9.0, we have changed how getParameterValue function behaves. To retrieve the value of an environment variable, this option must now be explicitly configured for that variable.

To learn more about how to enable this when running a plan or debugging a step, see Commonly Used Functions, section Other operations.

MDM

Date Picker

The date picker in both MDM and RDM now allows easier selection of a particular date.

ataccama 13.9.0 release notes mdm date picker

Loading Additional Drivers

MDM now natively supports the ability to load additional libraries from a dedicated location in both on-premise and PaaS deployments. External driver libraries for the most common data providers and consumers have been tested. See Loading Additional Drivers for details.

AI Matching Improvements

Generating training pairs is now as fast as it was originally before the AI Matching persistence was introduced in version 13.8. In addition, a Remove Model button has been added to the more options menu that allows you to remove an existing AI Matching model and start a new one from scratch.

AI Matching now also supports standard Prometheus metrics for monitoring (see Monitoring Metrics).

Logging Filters and Security Headers

MDM Server HTTP requests can be selectively logged using logging filters and server responses can be configured to contain security headers (see MDM Server Application Properties).

Upgrade Notes

To determine your upgrade path for version 13.9.0, please see the MDM Upgrade Procedure and MDM 13.9.0 Upgrade Notes.

RDM

Date Picker

The date picker in both MDM and RDM now allows easier selection of a particular date.

ataccama 13.9.0 release notes rdm date picker

Upgrade Notes

There are no version specific upgrade notes for 13.9.0, to determine your upgrade path see RDM Upgrade Procedure.

Was this page useful?