Ataccama 14.1.0 Release Notes

Data observability allows you to monitor entire systems with minimum configuration, which is crucial as the size and complexity of data landscapes grow.

Configure data observability on your chosen source by selecting the Data Observability tab and following the instructions found in Data Observability. After domain detection has been run on the system, you can select catalog items for closer monitoring by selecting terms and excluding or including individual items as necessary.

Select the best times to run checks, and the system does the rest. View issues and take recommended actions in the Data Observability Dashboards.

It is now possible to enable pushdown processing when you connect to a Snowflake warehouse so that data quality processing occurs directly in your Snowflake warehouse rather than within Ataccama ONE Data Processing Engines (DPEs). However, there are some limitations regarding the DQ processing configurations that can be executed in Snowflake. For instructions about enabling pushdown processing, see Relational Database Connection. For full details of processing and limitations, see Snowflake Pushdown Processing.

With Tasks, you can manage your workload in ONE on a kanban board. Collaborate with your coworkers on the same tasks and create subtasks for each team member to better organize your work.

You can create and assign a task directly from Tasks or from any entity, such as catalog items, terms, and monitoring projects. For more information, see Tasks.

On the task kanban board, you can also manage workflow tasks for granting access to entities (access request type). These are created when a user requests a change in the access level and are shown on the board for both the user who created the request and the task assignee.

To view your pending and resolved access requests, open Workflows > Overview. For more information about how to configure the access request workflow, see Workflows.

Use comments to share feedback, resolve questions, or add additional information to entities (terms, rules, catalog items) in a structured way. Comments allow you to collaborate efficiently across teams and remove unnecessary barriers, such as the need to schedule meetings or negotiate multiple communication channels.

You can attach files and images to your comments, tag users or assets, and close comments once resolved. For more information and configuration options, see Comments.

We have reworked the identity and access management system to make it easier to configure the authorization privileges of your employees. After you upgrade to 14.1.0, make sure you configure everything that is necessary for access management in ONE.

Start by assigning users into groups with various global roles. Next, manage access in ONE by sharing access to nodes with particular users or groups with corresponding access level rights and by setting access levels on user global roles and identity provider roles. For more information, see User Access Management.

You can now easily export catalog items to another data source, including the new module ONE Data. This creates a table in your data source based on the selected catalog item. In addition to this, data export creates a corresponding catalog item in the Knowledge Catalog. To learn more about how the feature works, see Data Export.

To start exporting, navigate to the catalog item you want to work with and choose Export in the more options menu.

You can now configure available connectors, change connection throttling rules, or provide a new runtime configuration for Data Processing Engine (DPE) directly in DPM Admin Console. In addition, authorization settings for DPE instances are also handled in DPM Admin Console (Authorized Components tab).

Other DPE parameters are defined depending on the deployment type (for example, in the application.properties configuration file for on-premise deployments, or using environment variables). However, the properties set in DPM Admin Console take higher priority over other configuration sources. For more details, see DPM and DPE Configuration in DPM Admin Console.

The Overall Validity metric in ONE has been replaced with Overall Quality. Whereas overall validity reflected only the results of rules of the data quality dimension type 'validity', the overall quality is calculated from the results of rules of contributing dimensions. You select which dimensions will contribute to overall quality in the data quality dimension settings. For more information, see Data Quality Dimensions.

Whilst the overall quality metric is visible throughout the application, in the current version you will only see information for individual dimensions in the Data Quality section of the application.

Users who purchased Data Stories can now manage all BI reports built on catalog items in the Data Stories tool. The connection between ONE and the Data Stories tool allows you to better explore your data and visualize it in a number of ways. While you can preview all reports and manage their metadata in ONE, reports can only be changed in Data Stories.

Before you can manage reports from Data Stories in ONE, make sure all prerequisites regarding the connection configuration are met. For more information, see Reports.

The Notification Center helps make sure you don’t miss anything. Here, you can see all notifications in full-screen, filter by notification type, or see unread notifications only. Click any notification to be redirected to the entity in question. For more information, see Notification Center.

The Smart Resolve feature lets you do the following:

This is useful when you upgrade to a new version of ONE, which can introduce issues between the new default layout and your custom layouts.

To view conflicting layouts, go to Global Settings > Custom Layouts > Issues tab. Custom layouts that are showing conflicts with the default layout are listed with a Pending review status.

To use Smart Resolve, select a layout and review the differences between versions. Click Smart resolve to attempt to automatically merge the conflict. Click Preview to make sure you’re happy with changes, and then click Save and publish.

Entities are now categorized into two types:

By default, both the Metadata Model list and the Model Graph are filtered to only show Business entities. To view all entities, select the All filter.

To determine your upgrade path, see ONE Gen2 Upgrade Guide.

Once your ONE Data tables are ready, you can enhance your data by editing the data inline and modifying the table structure on the spot. All your changes are applied instantly.

To easily find, analyze, and edit the correct records, use the extensive filtering options with condition grouping. Pause filtering temporarily to browse the whole data set as needed.

Use DQ evaluation on ONE Data tables to keep track of how your data evolves and make sure you stay on top of any DQ issues. Thanks to inline editing, you can fix any errors without delay.

DQ results are available on attribute, row, and cell level and calculated during profiling or DQ evaluation by applying DQ rules to glossary terms assigned to specific attributes. You can easily initiate DQ evaluation from the table details page at any point using the Evaluate Data Quality option.

The results that you see on the Data tab in ONE Data correspond to the overall quality determined using globally configured DQ dimensions.

In addition to using DQ rules and glossary terms to monitor the data quality of your ONE Data tables, you can also use ONE Data tables as reference data in DQ rules with is from catalog item condition. The rule logic can now be configured so that the data is updated in real time. To do this, set data updates to On data change when defining the condition.

Make use of ONE Data tables outside of the Ataccama ONE Platform using the Data export feature (see Data Export). This is particularly handy for synchronizing data between different data sources.

For example, if you imported some reference data from Snowflake that turned out to be incomplete, you can validate it and fix the issues in ONE Data. Then you can export it back to Snowflake and perform a join query with the existing table.

Share data across your organization and assign records to specific users thanks to the User data type attribute. To keep the communication seamless, create tasks and comments.

You can also visualize and explore your data using Data Stories, all within the same platform. See Data Stories User Guide.

Data Stories can now support using catalog items from ONE as well as ONE Data tables. Supported connection types are AWS Aurora PostgreSQL, Snowflake, and PostgreSQL.

With a couple of clicks, you can now access Data Stories from the Knowledge Catalog and build interactive stories and explorations from your catalog items.

For more information about creating stories or explorations using the Knowledge Catalog or ONE Data tables as data sources, see Create Stories from ONE and Create Explorations from ONE.

Use this new feature to understand the nature of your data at one glance. To perform different explorations at once, use the tabs embedded in Data Explorer.

You can also explore data in more detail thanks to the intuitive interface for building visualizations. You can then add these visualizations seamlessly into any story. For more information about Data Explorer and its features, see Explorations.

You can now generate matching proposals using the AI Matching functionality. The AI model is trained based on all previous user matching decisions, or can be manually trained as needed, in case there are not enough matching decisions or to improve the training quality.

After matching proposals are generated, you can see their confidence score on a graph that helps you decide whether to use or discard them. For more detailed information, see AI Matching.

You can now access matching proposals both from the MDM Matching step and AI Matching in one place and work with them in the same way. On the matching proposals listing tab, you can browse, filter, and select matching proposals for direct resolution, or create a task for it. When you open a matching proposal, you can add related proposals, compare the records, and resolve proposals. Your decisions are then used to further train the AI model.

To learn how to access matching proposals and how to work with them, see Matching Proposals.

We have replaced issues and drafts with tasks to simplify and improve how you work with DQ issues. Problem descriptions, record examples, and current data changes are no longer stored separately as issues and drafts; they are now all stored and managed together as tasks.

As a managing data steward, you can create tasks (create records, fix DQ issues, review matching) in a self-service way and assign them to a group of stewards or a single steward. Configure task types that serve as templates to easily add new tasks. To learn more about creating tasks, see Tasks Overview.

Data stewards can access their work queue and start resolving a problem. If you edit data without being assigned to a task, the task is created in the background for further use.

Any changes made need to be published using the publishing workflow, which can include an additional approval step. For more information about publishing changes, including how to specify the default assignment for each workflow transition, see Publishing Workflow.

See all tasks from the dashboard or the left navigation panel. For more details, see Accessing Tasks.

The MDM Server and webapp now use the same liveness and readiness probes as the rest of the platform. See Monitoring Configuration.

MDM can now check for compatibility of all main components on startup. See MDM Version Check.

You can now define a custom folder for storing licenses (as an addition to the user home folder). See MDM Server Application Properties.

The following MDM features are no longer available starting from version 14.1.0:

To determine your upgrade path for version 14.1.0, see the MDM Upgrade Procedure and MDM 14.1.0 Upgrade Notes.

You can now access the Admin Console directly from the RDM left navigation panel.

The RDM Webapp can be configured to repeat unsuccessful attempts to connect to databases and Keycloak before starting. See RDM Application Properties.

To determine your upgrade path, see RDM 14.1.0 Upgrade Notes.

We have introduced new Comment, Task, and Workflow services. To learn more about the features they deliver, see Comments and Tasks and Workflows respectively. If you are upgrading from v13.9.x, these services must be enabled as described in ONE Gen2 Upgrade Guide.

ONE Data is a new ONE module offered as part of Ataccama ONE Platform as a Service (PaaS) solution. Use ONE Data to edit data and table structure directly in the application, create governed data sets or reference data. For more information, see ONE Data User Guide.

Data Stories is now available as part of Ataccama ONE PaaS solution. Access Data Stories from the Knowledge Catalog and create compelling stories and explorations from your catalog items. You can also use Data Stories with ONE Data tables. To learn more, see Welcome to Data Stories.

We have retired the Configuration Service. For self-managed, on-premise deployments, all module configuration is now handled primarily through etc/application.properties files.

If you are upgrading from v13.9.x, the remaining configuration must be backed up and the service disabled following the instructions provided in ONE Gen2 Upgrade Guide.

Starting from this version, AI Matching is offered only as part of Ataccama ONE Platform as a Service solution.

Starting from 14.1.0, we no longer support production deployments on Windows for the following Ataccama products:

The products listed are no longer tested or optimized for Windows environments and any instances running on Windows are no longer eligible for technical or other assistance. However, we will continue providing Windows packages that you can use for local project development for these products.