Run DPM Job
Starts processing of a plan or component using remote Data Processing Module (DPM).
Configuration parameters
Name | Type | Description | ||
---|---|---|---|---|
Main Plan |
mandatory |
Points to the main ONE plan that should be executed. |
||
Main Plan Path |
optional |
The path to the main plan at the remote site. If not defined, the local path is used by default. |
||
Runtime Configuration |
optional |
Points to the runtime configuration that should be applied. |
||
ONE Platform |
mandatory |
The name of your instance of ONE Platform. |
||
Priority |
optional |
Sets the priority of the job in the DPM job queue.
The default value is The higher the value, the higher the priority. |
||
Zip |
optional |
If set to |
||
Async |
optional |
If set to By default, jobs are executed synchronously ( |
||
Force Cluster Launch |
optional |
If set to |
||
Cluster Name |
optional |
The name of the Spark cluster on which the job should be executed.
|
||
Cluster User |
optional |
Sets the Spark cluster credentials. Used if the credentials are not provided in the default configuration or if you want to use another set of credentials. If Spark credentials are not provided, the authentication is skipped. |
||
Cluster Password |
optional |
Sets the password for the Spark user. If not provided, the password file is checked instead. |
||
Cluster Password File |
optional |
Points to the file that contains the password for the Spark cluster. |
||
Working Dir |
optional |
The absolute path of the working directory from which relative paths are computed.
If not set, it defaults to the current working folder.
If set to Must be defined as an absolute path. |
||
Root Dir |
optional |
For Unix-like paths, if not specified, the system default is used ( |
||
Files |
optional |
Points to additional input files, such as lookups, components, CSV files:
|
||
Links |
optional |
Points to files from ONE Object Storage. Consists of two values, the first one being the path that Executor uses when running the job, the second one a link that refers to the actual location of the file in the Object Storage. |
||
Path Vars |
optional |
Defines additional path variables.
For more information about workflow variables, see Expressions in Workflows.
Paths and other string values to files need to be enclosed in double quotes, for example: |
||
Arguments |
optional |
If using parametrized components, this parameter is used to configure those parameters. Each argument takes two values: a key and a value. |
||
Mount Drivers |
optional |
Used if the job needs access to a database.
DPM and DPE add this database driver into the runtime configuration, in the If a connection is already defined, it should point to the driver name ( |
Was this page useful?