Snowflake UDF Upgrade Notes for Data Quality Gates

DQ Gates 1.3.0 Upgrade Notes

Not applicable DQ results

The UDF output can now identify records where a rule cannot be meaningfully applied, through a new top-level overall_result field (PASSED, FAILED, or NOT_APPLICABLE). This lets you separate records that genuinely failed from records that fall outside a rule’s scope.

For most uses, no action is required after upgrade. The existing passed, score, and rule_instance_results fields are unchanged, so existing integrations continue to work.

If you start using Not applicable results and process the UDF output programmatically, review your integrations if they:

Validate the UDF output against a strict, fixed set of fields. The new overall_result field is now present in the output.
Assume the result is only ever passed or failed. To tell failed records apart from those the rules could not be applied to, use overall_result rather than passed.

NOT_APPLICABLE is supported in both Snowflake UDFs and local Python. It requires a connection to Ataccama ONE 17.1.0 or later, and a firewall rule that uses a dimension with a Not applicable result defined.

For more information, see Results.

DQ Gates 1.2.0 Upgrade Notes

Firewall listing method replaced

Firewall listing now supports retrieving firewalls by a list of IDs in addition to AQL filter expressions. The new get_firewall_definitions client method replaces the previous get_firewall_ids helper.

If you have copied firewall listing code into custom scripts, update them as follows:

Remove the from ataccama_one_snowflake import get_firewall_ids import.
Replace get_firewall_ids(client, aql_filter=…) calls with client.get_firewall_definitions(filter=…).
Replace references to the id attribute with firewall_id (for example, fw.id becomes fw.firewall_id).
Wrap the result in list() if you need to iterate over it multiple times, as get_firewall_definitions returns an iterator.

Was this page useful?