Hi,
when deploying a workflow to the hub which stores / downloads data, that usually resides in the workflows data directory. Exposing that location to another workflow can become cumbersome. With lots of IOPS on one disc, speed (throughput) could become another chokepoint too.
Having a universally accessible file storage location would ease shared access to data, help reduce the size of the workflow, improve security and speed while potentially saving costs (AWS EBS volumne vs. S3 bucket).
Adding to this, provisioning a Hub, team or user based data-directory improves overall managability as data storage becomes centralized.
I’d like to propose to:
- Add the administrative Hub-ability to mount / connect a data storage
- Create a node or expose that dat storage to the file-nodes
Best,
Mike