User Community Service Desk Downloads
If you can't find the product or version you're looking for, visit support.ataccama.com/downloads

Ataccama 13.6.0 Release Notes

This page contains the release notes for version 13.6.0 of the entire Ataccama ONE Gen2 platform. Release information affecting all modules in the platform can be found in the first part, whereas platform and module specific information can be found in the corresponding ONE, MDM, and RDM sections.

Release information

Products

ONE Data Governance, ONE Data Quality and Governance, ONE RDM, ONE MDM

Release date

2022-03-07

Downloads

support.ataccama.com/downloads/13.6.x

ONE

AI Core module has been split

The AI Core module has been divided into the following services, based on the features for which they are responsible:

  • AI Matching service: Matching Manager.

  • Anomaly Detection service: Anomaly Detector.

  • NLP Search services: Autocomplete, Spellchecker, Translator.

  • Term Suggestions services: Feedback, Neighbors, Recommender.

While all machine learning features have been preserved, this has the following practical implications:

  • The services are now distributed as individual packages.

  • The configuration is handled separately for each service.

To learn more about the configuration updates, refer to Upgrade Guide. The configuration reference for each service is available at the following pages:

Data source throttling

Use the set of three new DPM properties to allow for simultaneous and stable browsing of data sources and execution of DPE jobs.

Database drivers for remote execution

Beginning with 13.6.0, database drivers can no longer be sent along the plan during remote execution. Make sure the file name of the database driver in your DPM instance matches the file name of the driver in ONE Desktop or the value of -md parameter when using DPM CLI to remotely execute a plan.

ONE Desktop

ONE Metadata Writer enhancements

When writing records, ONE Metadata Writer step now has two output streams. In the output labelled out it writes all readable records and you can now set the strategy for handling errors when reading records. In recovery_audit stream, all records including the unreadable records are logged into a database or into a file and a progress report is added to the log. Double-click your ONE Metadata Writer step and select Advanced to set recovery_audit stream details and error handling strategy.

ONE Web Application

Admin users will notice that there has been some name changes in parts of the web app navigation. These are as follow:

  • What was Organization in the left-hand menu is now Global Settings.

    ataccama 13.6.0 release notes navigation updates
  • The Upgrade Center is now System Changes.

    ataccama 13.6.0 release notes navigation updates system changes
  • Model Graph is now found as a tab within the Metadata Model section, rather than as a distinct list item.

    ataccama 13.6.0 release notes navigation updates metadata model

Time series analysis

You can now analyze time series data and run anomaly detection. Time series analysis can be configured for any catalog item with at least one column containing timestamp information, meaning you can detect anomalies on aggregated data for a specific time instance. This configuration is fully based in the user interface. For more information, see Time Series Data.

ataccama 13.6.0 release notes time series analysis

Anomaly detection sensitivity

Anomaly detection sensitivity can now be configured in three different instances:

  1. Globally for profiling (admin users only). You can set the sensitivity of anomaly detection when profiling, per profiling configuration (e.g. Full Profiling or Sample Profiling). This sensitivity will be applied whenever that profiling method is run.

  2. Per monitoring project. Anomaly detection sensitivity can be selected on a monitoring project level and will apply to all items in that project when monitoring is run.

  3. Per time series configuration. Anomaly detection sensitivity can be selected on a time series configuration level and will apply when analysis is run.

New business friendly rule condition

Two new options have been added to the list of options in the rule Condition Builder: Matches regexp and Does not match regexp.

ataccama 13.6.0 release notes new rule condition

Parallel processing for DQ evaluation

  • MMM creates one DQ evaluation job for each data source, allowing you to use tables from multiple networks in a single monitoring project.

  • An admin is able to increase global parallelization, splitting each of these jobs into multiple smaller jobs. This can be done both globally and per monitoring project.

    • Global configuration is via the property plugin.monitoring-project.ataccama.one.monitoring-project.dq-processing-parallelism. See Additional Configuration Options for more information.

    • Project configuration is achieved within the web app, as can be seen below. Select Advanced settings and then use the toggle in Parallel processing and define the value.

      What is configured here has priority over global settings.
      ataccama 13.6.0 release notes parallel processing
Data retention and parallel processing accessed via Advanced Settings

The data retention feature introduced in 13.5.0 will no longer be found by selecting Auto results removal but in Advanced Settings, alongside the project parallelization settings.

Filter for anomalous attributes

When anomalies have been detected in a catalog item, in the catalog item Overview you can now choose to display only the attributes with anomalies.

ataccama 13.6.0 release notes filter anomalous attributes

SQL catalog items

It is now possible to create a catalog item via SQL query in the ONE Web Application. This allows you to easily combine and transform catalog items, directly in the web application. SQL catalog items are added into the Source folders or workspaces.

Currently, SQL queries can only be used to create new catalog items when you are using JDBC and Metastore connections.

SQL Catalog Items can be created from and viewed in Sources and Catalog Items list in Knowledge Catalog. When creating a catalog item using an SQL query, the following workflow is applied:

  1. Select the source for the future SQL catalog item.

  2. Transform catalog items with SQL, for which validation of the query and a preview of the item are available:

  3. Review the general information of the newly created catalog item.

Specific configurations on permissions and sources are required. These can be found in user-access-management:configure-permissions-frequent-scenarios.adoc and Data Sources Configuration.

MDM

In this version, native services available on HttpEndpoint in both SOAP and XML formats are not secured by default and additional configuration must be used. For more information, see Native Services.

High availability

Instead of relying on Zookeeper, MDM high availability setup now uses database locking for managing read-only and read-write nodes.

ataccama 13.6.0 release notes high availability

Database locking is configured in MDM Server Application Properties. For details, see High Availability Overview.

MDM Webapp auditing

MDM Webapp audit events can be stored in a database, as configured in MDM Server Application Properties. Multiple event types can be filtered:

ataccama 13.6.0 release notes webapp audition

For details, see Configuring Audit Log.

Monitoring metrics

MDM monitoring now supports Prometheus metrics. See Monitoring Configuration for details.

Upgrade notes

There are no version specific upgrade notes for 13.6.0, to determine your upgrade path see MDM Upgrade Procedure.

RDM

Upgrade notes

There are no version specific upgrade notes for 13.6.0, to determine your upgrade path see RDM Upgrade Procedure.

Was this page useful?