Hi,
working on the latest data challenge I am processing the data using the Parallel Chunk nodes. Nothing special as I am using them almost on a daily basis.
Though, I noticed an extreme UI latency despite having enough system resources available. Please see my screen recording (download).
I can work with the situation and will share the workflow once I have completed the challenge.
Updaate
I believe I figured out what is happening or at least have a good suspicion:
- Some CPUs are highly utilized but not all
- The UI lag is triggered upon parallel execution indicating that UI rendering is happening using CPU instead of GPU
- The rendering process is done on one of the heavy utilized cores causing congestion
The problem I see here … I utilized all cores before in even more demanding processes like web crawling with +10 sessions all while crunching data in another workflow but without any perceived UI lag.
This issue also appeared only with the latest update of Knime or any of it’s extensions. I am doing nothing fancy or totally new either.
Best
Mike