When launching KNIME, the path I have set is an SSD, and as shown on the menu bar /Volumes/X31/KNIME – This is where I figure any workflows and their data are being saved each day, including Parquet Reader/Writers, etc. I can see the folder on there titled with my workflow being about 39 GB.
But I got a warning on my Mac that I was running out of space, and had to do some digging where I saw a path of /private/var/folders/q6/v…/T/knime_my_project_16757 totaling 71.4GB.
What is this and can it be safely deleted?
If so, and I delete it when KNIME is fully closed closed, will this reset any saved executed nodes I have?
Lastly, if KNIME is writing to this location, is there a way to redirect that to be on my SSD instead?
@jordanm55 you can check and change the folder where knime is storing the temporary files. I am not 100% certain how knime does handle expired temporary files.
Also: using an external SSD can cause delays so you would want to test that.
I use tools like Grand perspective to see large files in knime and try to reset the workflows.
Also there is a list of individual files that contain the stored data inside a workflow
Thank you, I gave that a read on the night I saw your swift reply (thank you) though I soon after discovered the knime.ini file where I could set the directory of the temp files to the SSD instead with
I know they’re temporary, but running out of space was an issue and I didn’t want any issues to arise if I hit the max midway through something. And yes unfortunately I know that using an SSD is not ideal, but once I do some heavier stuff later in the workflow, I’m already anticipating setting up a solid spec dedicated server since I can’t upgrade my Mac or to Windows by any meaningful amount at the moment.
Also didn’t notice this at first, but saw today there is a setting in Preferences > KNIME to set the temp file director rather than do what I did in the knime.ini file lol.
Figured I’d post this just in case someone else comes across it with a search.
as far as I know these temporary files are created during the workflow runs. Mostly if there is not sufficient memory. As these writing/reading processes are slow compared to in RAM processes I highly recommend to put these folders not on an external drive unless you have newer thunderbolt interfaces.
In the past I had similar issues when my workflows handled larger amount of data and the workflows crashed. At that time I deleted these files manually and later with a script just right before I started KNIME.
