Ataccama ONE Agentic ONE Desktop ONE DQ&C ONE MDM ONE RDM ONE Runtime Server
latest (17.0.0) 16.3.x 16.2.0 16.1.0 16.0.0 15.4.0 15.3.0 15.2.0 15.1.0 14.5.x 13.9.x 13.8.x 13.7.x 13.6.x 13.5.0 13.4.x 13.3.x 13.2.x
User Community Service Desk Downloads

DQ&C 16.3.1 Upgrade Notes

Connection-timeout-property for JDBC drivers

All JDBC data source drivers now require the connection-timeout-property setting.

The property specifies the driver-level property name and unit used to enforce a socket or read timeout on JDBC connections. If it is missing, Data Processing Engine (DPE) can become completely blocked when a data source is unresponsive.

The property follows this pattern:

plugin.jdbcdatasource.ataccama.one.driver.<driverId>.connection-timeout-property = <property>, <unit>

Where

  • <property> is the JDBC driver property name.

  • <unit> is s (seconds) or ms (milliseconds).

Set the value to NONE for drivers that do not support a timeout property.

When upgrading to 16.3.1, verify that each configured driver (default or custom) includes connection-timeout-property.

Reference values for default drivers

For full configuration details, see Data Sources Configuration.

Driver Value

Amazon Aurora MySQL

socketTimeout, ms

Amazon Aurora PostgreSQL

socketTimeout, s

Amazon Redshift

socketTimeout, s

Apache Cassandra

ReadTimeoutMillis, ms

Arrow Flight SQL (Dremio)

socketTimeout, ms

AWS Athena

SocketTimeout, s

Azure Data Explorer (ADX)

socketTimeout, ms

Azure Synapse Analytics

socketTimeout, ms

BigQuery

Timeout, s

IBM Db2

blockingReadConnectionTimeout, s

IBM Netezza

loginTimeout, s

Informix

INFORMIXCONTIME, s

MariaDB

socketTimeout, ms

MS SQL

socketTimeout, ms

MySQL

socketTimeout, ms

Oracle

oracle.jdbc.ReadTimeout, ms

PostgreSQL

socketTimeout, s

SAP HANA

webSocketPingTimeout, s

Snowflake

loginTimeout, s

SQLite

NONE

Sybase

com.sybase.CORBA.socketTimeout, s

Teradata

NONE

Databricks JDBC batch inserts

Starting with Simba 2.6.38 and OSS 3.0.5, the JDBC Writer inserts records one at a time, causing slow writes. Ataccama ONE now automatically restores batched inserts for Simba 2.7.0+ and OSS 3.0.5+.

If you are using Simba 2.6.38–2.6.x, manually add ;EnableNativeParameterizedQuery=0 to your connection string.

For details, see Slow write operations on Databricks JDBC connections.

Advanced encryption between DPM and DPE

Available from 16.3.1-patch7.

Apply advanced encryption to communication channels between Data Processing Module (DPM) and Data Processing Engines (DPEs), such as gRPC messages and configuration data.

We recommend switching to advanced encryption at your earliest convenience.

Before you start, ensure there are no encryption related warnings on the Engines tab in the DPM Admin Console. If there are, update the DPE configuration to address this or remove the engine.

If advanced encryption is not configured, the environment continues to work using standard encryption, which is now considered obsolete.

If you are using an Ataccama Cloud environment, contact Ataccama Support for configuration assistance.

To enable advanced encryption:

  1. Ensure each connected DPE has the following settings configured:

    properties.encryption.keystore=<keystore_file>
properties.encryption.keystore.passwordFile=<password_file>
properties.encryption.keystore.keyAlias=<alias_for_encryption>
internal.encryption.keystore=<keystore_file>
internal.encryption.keystore.passwordFile=<password_file>
internal.encryption.keystore.keyAlias=<alias_for_encryption>

    For configuration details, see Encryption Configuration.

  2. Wait for the DPE instances to become ready, then check their status in the DPM Admin Console.

    • If no warning is displayed, continue to the next step.

    • If a warning appears, verify the encryption properties are configured correctly.

    • If the status is UNKNOWN, the probe hasn’t run yet. Wait until the status changes. If it changes to INDETERMINATE, see DPE status is INDETERMINATE.

      Advanced encryption warning in DPM Admin Console

  3. (Ataccama Cloud only) Once all DPE instances are connected and show no warnings, apply the following Helm override:

    global.dataEncryption.advancedEncryptionEnabled=true

DPE status is INDETERMINATE

The INDETERMINATE status is not directly related to the advanced encryption settings. Instead, it indicates one of the following:

  • There is a technical issue in communication between DPM and DPE. Verify the communication is correctly set up; see Authorized components.

  • There are no JDBC drivers configured for the DPE instance using advanced encryption. See Data Sources Configuration.

Was this page useful?