If you can't find the product or version you're looking for, visit support.ataccama.com/downloads

Wait For File

Waits for a file or directory to appear (or disappear) with a defined timeout. If the file does not appear (disappear) in a given period of time, the task fails. Otherwise, it succeeds and returns FINISHED_OK state.

Since version 12, this task contains the functionality of the HDFS Wait for File task.

Properties

Name Type Description Expression support

Name	Type	Description	Expression support
Polling Interval (ms)	mandatory	The interval to wait between two checks of the condition. A value higher than zero is required.	expression evaluating to integer
Timeout (ms)	mandatory	The maximum amount of time the task waits for the condition to be true. After this time, the task fails (that is, it does not wait anymore even if the condition is only being checked). A value higher than zero is required.	expression evaluating to integer
File Name	mandatory	Path to the files to appear (disappear). The file can be local, on Amazon S3 or Azure Data Lake Storage Gen1 server and on HDFS (if your product contains ONE Spark DPE). The remote resources are accessible with the `resource://<resourceName>/<path>/<inputFile>` syntax. Supports using wildcards. If multiple files match the pattern, the task waits until all matching files disappear.	semi-expression
Wait For	mandatory	If the value is set to "appear", the task waits for a file appearance. If the value is "disappear", the task waits for the file removal (for example, some lock file). Default value: `appear`.	semi-expression

Polling Interval (ms)

mandatory

The interval to wait between two checks of the condition. A value higher than zero is required.

expression evaluating to integer

Timeout (ms)

mandatory

The maximum amount of time the task waits for the condition to be true. After this time, the task fails (that is, it does not wait anymore even if the condition is only being checked). A value higher than zero is required.

expression evaluating to integer

File Name

mandatory

Path to the files to appear (disappear). The file can be local, on Amazon S3 or Azure Data Lake Storage Gen1 server and on HDFS (if your product contains ONE Spark DPE). The remote resources are accessible with the resource://<resourceName>/<path>/<inputFile> syntax.

Supports using wildcards. If multiple files match the pattern, the task waits until all matching files disappear.

semi-expression

Wait For

mandatory

If the value is set to "appear", the task waits for a file appearance. If the value is "disappear", the task waits for the file removal (for example, some lock file).

Default value: appear.

semi-expression

Sample

<executable class="com.ataccama.adt.task.exec.EwfWaitForFileTask">
    <pollingInterval>100</pollingInterval>
    <timeout>1000</timeout>
    <fileName>${waitForFileName}</fileName>
</executable>

Was this page useful?