I have Spark 2.4 running on Cloudera Quickstart VM (CDH v5.13). I installed Spark-Job Server as per the guilde lines from the here. When I try to run the example Workflow named "01_Spark_MLib_Decision_Tree) from Knime (v4.1) I get the following error.
ERROR Table to Spark 0:202 Execute failed: Cannot read input file on jobserver: \tmp\spark2-job-server\upload\knime-table2spark1957749675575975821.tmp-2020-01-17T22_17_11.517-08_00.dat
The “Create Spark Context (JobServer)” node executes successfully. I have looked at the Spark-job-server log and has no error logged in any of the log files. What is this error referring to and how can I tackle the issue? (I have installed Livy, as that was the recommended but I faced another problem with that so I tried using Spark Job Server).