Not sure whether this is actually related, but I had many, many problems with these “snappy” files as well. Suggest to check here if it might be related:
Encountered this very scary error with a long-running workflow during the night occurring at the “Table Row To Variable Loop Start” node. Any ideas? (the machine was running unattended, there was enough disk space, and I didn’t tamper with any temp files of course).
KNIME 4.1.1, macOS 10.14.6
– Philipp
2020-03-01 02:15:52,646 : WARN : KNIME-Worker-79-Java Edit Variable 0:475 : : JavaEditVarNodeModel : Java Edit Variable : 0:475 : ******* Downloading 30006/40313 : 74.43 % *******
2020-03-01 …
At the end, changing the storage format to GZIP fixed the issue (details very last post in the thread):
@mlauber71
WOW! Again many thanks for these ideas I think this is a great collection of best practices, which I will try step by step!
For the time being, setting the compression to GZIP using -Dknime.compress.io=GZIP (as you had suggested initially), did the trick, and the WF ran successfully.
– Philipp
3 Likes