Looping process is slow

KNIME Analytics Platform
1

Hi,

            I am running one python script using Recursive Loop Start node and Recursive Loop End node. The workflow will generate nearly 50,000 xml files and using XPath node i am parsing some elements from xml files and am aggregating using the loop end node. But the process speed is very very slow and suddenly at mid the execution got failed. 

Please guide me someone that how to process this workflow and also considering a speed.

Thanks & Regards,

Prasanna

2

Prasanna,

Two hints which may help:

  • Use "Parallel Chunk Loop" execution for speed
  • Adjust Java Heap size for completion

HTH,
E

3