Auto-Retry and md5 verify of download file nodes

Hi there,

I’d like to make two suggestions related to various file download nodes.

Auto-retry
Like for the http retriever node in Palladian an option to try again if a download fails would be wonderful.

Auto-Verify
I happen to face, when downloading thousands of files i.e. from S3, once in a while corrupt files like compressed archives. They are downloaded successfully but unpacking them is impossible. MD5 validation would be nice, wouldn’t it?

Thanks a lot
Mike

2 Likes

@mw,

we’re, indeed, currently working on this and similar nodes and added your suggestions to the requirements list. Hopefully, we’ll be able to make those options available to you with 4.2.

Thanks for your valuable feedback!!! If you have more ideas please keep them coming :smiley:
Best
Mark

4 Likes

This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.