On this page | |
Since | 17.5 |
This node creates work items that download content from a static list of URLs into files on disk. The downloads occur in-process but can happen during generation or cook.
You can batch all downloads into one work item (for small downloads) or launch separate processes for each download. You can also use a file://
URL to copy the contents of one file to another. For more information, see File Copy node.
TOP Attributes
|
string |
List of URLs to download content from. |
|
integer |
|
Parameters
Generate When
Determines when this node will generate work items. You should generally leave this set to "Automatic" unless you know the node requires a specific generation mode, or that the work items need to be generated dynamically.
All Upstream Items are Generated
This node will generate work items once all of the input nodes have generated their work items.
All Upstream Items are Cooked
This node will generate work items once all of the input nodes have cooked their work items.
Each Upstream Item is Cooked
This node will generate work items each time a work item in an input node is cooked.
Automatic
The generation mode is selected based on the generation mode of the input nodes. If any of the input nodes are generating work items when their inputs cook, this node will be set to Each Upstream Item is Cooked. Otherwise, it will be set to All Upstream Items are Generated.
Cache Mode
How the processor node handles work items that report expected file results.
Automatic
If the expected result file exists on disk, the work item is marked as cooked without being scheduled. If the file does not exist, the item is scheduled as normal.
Read Files
If the expected result file exists on disk, the work item is marked as cooked without being scheduled. Otherwise the work item is marked as failed.
Write Files
Work items are always scheduled and the excepted result file is ignored, even if it exists on disk.
Download File(s) During
Determines when to download the files.
Generate
File download happens during work item generation. This can be when the network starts cooking or when you explicitly ask to generate static items.
Cook (In-Process)
File download happen during the cook and within the graph cooking process.
Split Downloads Into Separate Work Items
When on, the node creates separate work items for each URL to download them in parallel. This is useful when downloading very large files. When off, the node creates one work item to download the URLs serially.
Verify SSl Certificates
When on, SSL certificate verification is performed on the URLs.
File Downloads
Specifies the URLs from which to download the files.
URL
URL of the file to download.
Tag
File tag to apply to the output files.
Filename
When on, specifies the file path to download the content to. When off, the node picks a filename based on the URL’s base name and places it in the working directory.
Examples
DownloadFile Example for Download File TOP node
This example demonstrates how to download a file using the downloadfile node.
See also |