Hi there,
I’d like to make two suggestions related to various file download nodes.
Auto-retry
Like for the http retriever node in Palladian an option to try again if a download fails would be wonderful.
Auto-Verify
I happen to face, when downloading thousands of files i.e. from S3, once in a while corrupt files like compressed archives. They are downloaded successfully but unpacking them is impossible. MD5 validation would be nice, wouldn’t it?
Thanks a lot
Mike