User Community Service Desk Downloads

Data Transformation Steps Reference

This reference details all available transformation steps and how to configure them.

Expressions and step configuration are not encrypted. Avoid including sensitive data such as passwords, API keys, or personal information.

Input and output steps

Input steps

Step Description Available for

Catalog item input

Reads data from the selected catalog item.

  • Standalone plan

  • Embedded plan

  • Transformation catalog item

Input

A generic input step that can be used to embed the plan into another or define inputs for transformation rules.

  • Embedded plan

  • Transformation rule

Output steps

Step Description Available for

Database output

Writes transformed data back to the data catalog by overwriting or appending existing items.

  • Standalone plan

  • Embedded plan

File export

Exports data to file storage locations such as Amazon S3 in CSV format.

  • Standalone plan

  • Embedded plan

Reference data output

Writes transformed data to a reference data table with upsert (update/insert), append, or replace operations.

  • Standalone plan (typically created via import workflow)

Output

A generic output step which can be used to embed the plan into another.

  • Transformation rule

  • Embedded plan

Data transformation CI

Outputs transformation catalog item (TCI) data flow results. The contents of the output are computed every time an action is run on the TCI.

  • Transformation catalog item (automatically added)

Steps available for all transformation types

The following steps work with standalone plans, embedded plans, transformation rules, and transformation catalog items:

Step Description

Add attributes

Adds new attributes to your data flow using ONE expressions.

Condition

Splits the data flow into two streams based on the ONE expression condition.

Delete attributes

Deletes selected attributes from your data flow.

Edit schema

Renames and reorders attributes in your data flow schema.

Transform data

Transforms attribute values using the ONE expression language.

Steps for plans and catalog items only

These steps are available for standalone plans, embedded plans, and transformation catalog items (not transformation rules):

Step Description

Embedded plan

Inserts an existing transformation plan created in ONE.

Filter

Filters out all records that don’t pass the ONE expression condition.

Group aggregator

Groups and aggregates records to consolidate data.

Join

Joins two separate data flows into a single data flow (vertical merge).

Pattern parser

Extracts structured data from unstructured text using AI-powered pattern recognition.

Split

Splits the data flow into three streams based on the ONE expression condition.

Union streams

Merges input formats of two defined inputs into a single output format (horizontal merge).

Was this page useful?