Ataccama 13.6.0 Release Notes
This page contains the release notes for version 13.6.0 of the entire Ataccama ONE Gen2 platform. Release information affecting all modules in the platform can be found in the first part, whereas platform and module specific information can be found in the corresponding ONE, MDM, and RDM sections.
Release information
Products |
ONE Data Governance, ONE Data Quality and Governance, ONE RDM, ONE MDM |
|---|---|
Release date |
2022-03-07 |
Downloads |
ONE
AI Core module has been split
The AI Core module has been divided into the following services, based on the features for which they are responsible:
-
AI Matching service: Matching Manager.
-
Anomaly Detection service: Anomaly Detector.
-
NLP Search services: Autocomplete, Spellchecker, Translator.
-
Term Suggestions services: Feedback, Neighbors, Recommender.
While all machine learning features have been preserved, this has the following practical implications:
-
The services are now distributed as individual packages.
-
The configuration is handled separately for each service.
|
To learn more about the configuration updates, refer to Upgrade Guide. The configuration reference for each service is available at the following pages:
|
Data source throttling
Use the set of three new DPM properties to allow for simultaneous and stable browsing of data sources and execution of DPE jobs.
Database drivers for remote execution
Beginning with 13.6.0, database drivers can no longer be sent along the plan during remote execution.
Make sure the file name of the database driver in your DPM instance matches the file name of the driver in ONE Desktop or the value of -md parameter when using DPM CLI to remotely execute a plan.
ONE Desktop
ONE Metadata Writer enhancements
When writing records, ONE Metadata Writer step now has two output streams.
In the output labelled out it writes all readable records and you can now set the strategy for handling errors when reading records.
In recovery_audit stream, all records including the unreadable records are logged into a database or into a file and a progress report is added to the log.
Double-click your ONE Metadata Writer step and select Advanced to set recovery_audit stream details and error handling strategy.
ONE Web Application
Navigation updates
Admin users will notice that there has been some name changes in parts of the web app navigation. These are as follow:
-
What was Organization in the left-hand menu is now Global Settings.
-
The Upgrade Center is now System Changes.
-
Model Graph is now found as a tab within the Metadata Model section, rather than as a distinct list item.
Time series analysis
You can now analyze time series data and run anomaly detection. Time series analysis can be configured for any catalog item with at least one column containing timestamp information, meaning you can detect anomalies on aggregated data for a specific time instance. This configuration is fully based in the user interface. For more information, see Time Series Data.
Anomaly detection sensitivity
Anomaly detection sensitivity can now be configured in three different instances:
-
Globally for profiling (admin users only). You can set the sensitivity of anomaly detection when profiling, per profiling configuration (e.g. Full Profiling or Sample Profiling). This sensitivity will be applied whenever that profiling method is run.
-
Per monitoring project. Anomaly detection sensitivity can be selected on a monitoring project level and will apply to all items in that project when monitoring is run.
-
Per time series configuration. Anomaly detection sensitivity can be selected on a time series configuration level and will apply when analysis is run.
New business friendly rule condition
Two new options have been added to the list of options in the rule Condition Builder: Matches regexp and Does not match regexp.
Parallel processing for DQ evaluation
-
MMM creates one DQ evaluation job for each data source, allowing you to use tables from multiple networks in a single monitoring project.
-
An admin is able to increase global parallelization, splitting each of these jobs into multiple smaller jobs. This can be done both globally and per monitoring project.
-
Global configuration is via the property
plugin.monitoring-project.ataccama.one.monitoring-project.dq-processing-parallelism. See Additional Configuration Options for more information. -
Project configuration is achieved within the web app, as can be seen below. Select Advanced settings and then use the toggle in Parallel processing and define the value.
What is configured here has priority over global settings. 
-
Filter for anomalous attributes
When anomalies have been detected in a catalog item, in the catalog item Overview you can now choose to display only the attributes with anomalies.
SQL catalog items
It is now possible to create a catalog item via SQL query in the ONE Web Application. This allows you to easily combine and transform catalog items, directly in the web application. SQL catalog items are added into the Source folders or workspaces.
| Currently, SQL queries can only be used to create new catalog items when you are using JDBC and Metastore connections. |
SQL Catalog Items can be created from and viewed in Sources and Catalog Items list in Knowledge Catalog. When creating a catalog item using an SQL query, the following workflow is applied:
-
Select the source for the future SQL catalog item.
-
Transform catalog items with SQL, for which validation of the query and a preview of the item are available:
-
Review the general information of the newly created catalog item.
| Specific configurations on permissions and sources are required. These can be found in user-access-management:configure-permissions-frequent-scenarios.adoc and Data Sources Configuration. |
MDM
| In this version, native services available on HttpEndpoint in both SOAP and XML formats are not secured by default and additional configuration must be used. For more information, see Native Services. |
High availability
Instead of relying on Zookeeper, MDM high availability setup now uses database locking for managing read-only and read-write nodes.
Database locking is configured in MDM Server Application Properties. For details, see High Availability Overview.
MDM Webapp auditing
MDM Webapp audit events can be stored in a database, as configured in MDM Server Application Properties. Multiple event types can be filtered:
For details, see Configuring Audit Log.
Monitoring metrics
MDM monitoring now supports Prometheus metrics. See Monitoring Configuration for details.
Upgrade notes
There are no version specific upgrade notes for 13.6.0, to determine your upgrade path see mdm-upgrade-procedure.adoc.
RDM
Upgrade notes
There are no version specific upgrade notes for 13.6.0, to determine your upgrade path see rdm-upgrade-procedure.adoc.
Was this page useful?