Data Transformation Steps Reference
This reference details all available transformation steps and how to configure them.
|
Expressions and step configuration are not encrypted. Avoid including sensitive data such as passwords, API keys, or personal information. |
Input and output steps
Input steps
| Step | Description | Available for | Documentation |
|---|---|---|---|
Catalog item input |
Reads data from the selected catalog item. |
|
|
Input |
A generic input step that can be used to embed the plan into another or define inputs for transformation rules. |
|
Output steps
| Step | Description | Available for | Documentation |
|---|---|---|---|
Database output |
Writes transformed data back to the data catalog by overwriting or appending existing items. |
|
|
Output |
A generic output step which can be used to embed the plan into another. |
|
|
Data transformation CI |
Outputs transformation catalog item (TCI) data flow results. The contents of the output are computed every time an action is run on the TCI. |
|
Steps available for all transformation types
The following steps work with standalone plans, embedded plans, transformation rules, and transformation catalog items:
| Step | Description | Documentation |
|---|---|---|
Add attributes |
Adds new attributes to your data flow using ONE expressions. |
|
Condition |
Splits the data flow into two streams based on the ONE expression condition. |
|
Delete attributes |
Deletes selected attributes from your data flow. |
|
Transform data |
Transforms attribute values using the ONE expression language. |
Steps for plans and catalog items only
These steps are available for standalone plans, embedded plans, and transformation catalog items (not transformation rules):
| Step | Description | Documentation |
|---|---|---|
Embedded plan |
Inserts an existing transformation plan created in ONE. |
|
Filter |
Filters out all records that don’t pass the ONE expression condition. |
|
Group aggregator |
Groups and aggregates records to consolidate data. |
|
Join |
Joins two separate data flows into a single data flow (vertical merge). |
|
Split |
Splits the data flow into three streams based on the ONE expression condition. |
|
Union streams |
Merges input formats of two defined inputs into a single output format (horizontal merge). |
Was this page useful?