Coming back to this since @Fernando brought it back up. Knime, maybe Windows 11 or both seem to have a serious performance issue when writing data to disk.
I created this workflow to easily create large amount of different data types.
When trying to write them to the disk, write speeds briefly burst to several hundreds of MB and then plummet down. Contrary to tests the write speed is far slower then expected indicating some sort of bottle neck:
5 GB Test file
Without whitelisting in Windows Defender
After whitelisting Knime
It’s been about ten minutes since the prev. screenshot and the SSD is not thermal throttleing. Yet, Knime is still writing but as seen above, it seems not to the second disc “E” as it is pretty much idle.
10 minutes later
@armingrudd there have been quite a few topics in the recent past about performance a regression. The not officially acknowledged Window fix of slow SSDs is installed but I do not see any improvement. Regardless of the backend type, row or columnar based, writing data should be … fast.
Yet, Knime or Winbdows (I really don’t want to blame any app here) seems to behave odd to say the least while writing data without writing data as the 2nd SSD is idle.
I hope the workflow above helps.
Best
Mike