When I run a workflow that contains about 614k rows, using table to spark, spark category to number, spark partitioning and then forest learner, on forest learner it stucks on 180-190th job and never move more. The EMR status is alive, other jobs take 8-15 minutes, so may be the problem in KNIME client(4.0.1) ? Job is freezed to 16 hours and more as shows Duration column from YARN application. The EMR cluster is run in yarn mode(cluster mode).
All possibly suggestions are welcome