Wait For File
Waits for a file or directory to appear (or disappear) with a defined timeout. If the file does not appear (disappear) in a given period of time, the task fails. Otherwise, it succeeds and returns FINISHED_OK state.
Since version 12, this task contains the functionality of the HDFS Wait for File task. |
Properties
Name | Type | Description | Expression support |
---|---|---|---|
Polling Interval (ms) |
mandatory |
The interval to wait between two checks of the condition. A value higher than zero is required. |
expression evaluating to integer |
Timeout (ms) |
mandatory |
The maximum amount of time the task waits for the condition to be true. After this time, the task fails (that is, it does not wait anymore even if the condition is only being checked). A value higher than zero is required. |
expression evaluating to integer |
File Name |
mandatory |
Path to the files to appear (disappear).
The file can be local, on Amazon S3 or Azure Data Lake Storage Gen1 server and on HDFS (if your product contains ONE Spark DPE).
The remote resources are accessible with the Supports using wildcards. If multiple files match the pattern, the task waits until all matching files disappear. |
semi-expression |
Wait For |
mandatory |
If the value is set to "appear", the task waits for a file appearance. If the value is "disappear", the task waits for the file removal (for example, some lock file). Default value: |
semi-expression |
<executable class="com.ataccama.adt.task.exec.EwfWaitForFileTask">
<pollingInterval>100</pollingInterval>
<timeout>1000</timeout>
<fileName>${waitForFileName}</fileName>
</executable>
Was this page useful?