Spark context on GCE

#1

HI,

How can I setup a Spark context on GCE on Google within a KNIME workflow?

Thanks,
Mihai

1 Like

#2

Hi @mihais1

you will have to either install Livy (recommended) or Spark Jobserver for your Dataproc cluster. For Livy, Google provides scripts that should make this easier:

IMPORTANT: You need to install Livy 0.5, not the current 0.6. Unfortunately KNIME currently has no Livy 0.6 support (planned to be added with December 2019 release).

Best,
Björn

0 Likes