HTTP Get
This task is used to download a resource via HTTP(S) protocol. A URL resource or a URL must be defined.
If the URL resource is used, then credentials for authorization can be defined in the Url Resource configuration. If the URL is used, then credentials for authorization can be defined in the User Name and Password properties.
The task sends requests until it receives the HTTP 200 OK status code, or until it exceeds the number of requests specified in the Retry property.
To use the HTTPS protocol, make sure you import the certificate to the Java truststore file: <JAVA_HOME>/lib/security/cacerts.
|
Properties
| Name | Type | Description | Expression support |
|---|---|---|---|
Url Resource |
mandatory |
Implementation and configuration of URL Resource. Possible implementations: URL Expression, URL Resource Bean. |
none |
File Name |
mandatory |
Path to a file where the result of a request is saved. The file can be local, on Amazon S3 or Azure Data Lake Storage Gen1 server and on HDFS (if your product contains ONE Spark DPE). Remote resources are accessible with the |
semi-expression |
Overwrite Flag |
optional; Default value: |
Permission to overwrite target file.
The task fails when Overwrite Flag is |
none |
Polling Interval (ms) |
optional;
Default value: |
The interval to wait between two requests. Value higher than zero required. |
none |
Retry |
optional Default value: |
Specifies how many times a request is re-sent before the task fails. |
none |
Http Headers |
optional |
Set of user defined parameters to pass to the request header. |
none |
Use Post Method |
optional |
When enabled, the task uses the HTTP |
none |
Post Params |
optional |
Set of user defined parameters to pass to |
none |
URL expression
| Name | Type | Description | Expression support |
|---|---|---|---|
Url |
mandatory |
URL must contain the protocol identifier (HTTP and HTTPS is supported). |
expression |
User Name |
optional |
Username used for authorization. It is used only with URL. |
none |
Password |
optional |
Password used for authorization; can be plain text or encrypted (recommended). The workflow editor encrypts password automatically. It is used only with URL. |
none |
URL resource bean
| Name | Type | Description | Expression support |
|---|---|---|---|
Url Resource Name |
mandatory |
Name of the Runtime Configuration to be used. |
semi-expression |
HTTP headers properties
| Name | Type | Description | Expression support |
|---|---|---|---|
Parameters |
optional |
Set of user defined parameters to pass to the request header. |
none |
Was this page useful?