So I’ve made a chain with multiple components that execute a python script node. What I’m doing is passing some numpy arrays and performing some operations on them from script to script.
For performance purposes I save these arrays in binary format because it is way faster than passing them as KNIME tables. I don’t mind the benefits of consistency checks on the data, I am just trying to increase the speed.
Are python nodes streamable or maybe is there a way to disable these consistency data checks or do something else to increase performance?
Loading and saving the numpy arrays seems like a bad practise to implement a whole chain, when for example you make care only for the resulting numpy array.