Dear KNIME users, I have difficulties to upload large csv files (> 200 MB) from a network drive into a knime analytics platform and from a local drive to the KNIME server. I am uploading with a “file upload widget” so that I am able to explore the workflow both locally and on the server. To circumvent the problem I am now pasting the folder path into a string widget, than select the file via table view and subsequently transfer the file to a temporary directory. Apparently the file transfer node has no problems with the size of the csv files and once they are in a temporary drive I can open them with a csv reader. A more elegant solution for me would be to use the file upload widget to just get the path of the local file and then transfer it to a temporary folder. However, it seems that there is no configuration in the file upload widget to just create the path? Are there any alternative solutions, the file chooser node does not work in a component and the server. I am using KNIME version 4.7.8. Thanks in advance for any ideas Stefan

File upload widget - just upload the path

mlauber71 August 26, 2024, 3:19am 6

@sscholz you could try and split the CSV into Parquet files which are compressed and then upload them individually. They can later be used as one big file again

1 Like