Snowflake Pushdown Processing
What is pushdown processing
Pushdown processing delegates profiling and DQ evaluation to your connected Snowflake warehouse instead of running them on Ataccama’s cloud runtime.
Instead of transferring data into ONE for processing, ONE generates SQL queries that run directly within Snowflake, leveraging its computational resources. Only results and invalid samples (if configured) are returned to ONE.
Snowflake pushdown processing is supported for profiling and DQ evaluation jobs.
- Pushdown profiling
-
Profiling runs on pushdown for all Snowflake connections. There are no limitations when running profiling in Snowflake pushdown compared to profiling in ONE.
- Pushdown for DQ evaluation
-
Pushdown processing for DQ evaluation can be enabled or disabled as required, as some limitations exist. See When to Use Snowflake Pushdown for DQ Evaluation.
| Transformation catalog items and SQL catalog items cannot be processed in pushdown. |
Why use pushdown processing
Using pushdown processing can improve performance, security, and scalability.
-
Performance: Evaluate millions of records in seconds.
-
Security: Data stays in Snowflake and only results (and invalid samples, if configured) are returned. There is no data transfer to external services; all processing runs on secured and governed Snowflake warehouses.
-
Infrastructure: Use your existing infrastructure to evaluate data—no need to set up and manage new processing servers.
Next steps
-
To decide whether pushdown is the right choice for DQ evaluation, see When to Use Snowflake Pushdown for DQ Evaluation.
-
Ready to enable pushdown for DQ evaluation? See Snowflake Connection.
Was this page useful?