CAN spark-tools support Scala?

loongel · August 5, 2016, 11:34am

Hi,

Is there a way to write scala in spark tool? Or, do we have any plan for scala python R script in spark?

bjoern.lohrmann · August 15, 2016, 4:30pm

Hi,

currently there is no Scala, python or R scripting support for KNIME Spark Executor. But there is Java scripting support via the "Spark Java Snippet" nodes. Everything you can do from Scala you can also do in Java (albeit a little less elegant ;)

Also, I am sorry to say that support for Scala/Python/R scripting currently is not on the roadmap. After all the point of using KNIME Spark Executor is not having to write code ;-)

Is there anything specific you want to do via scripting that is currently not covered by our Spark nodes?

Best,

Björn

karimhamdy · October 21, 2019, 10:15am

can spark-tools support python currently?

tobias.koetter · October 21, 2019, 11:02am

Yes, for a list of available PySpark nodes see here.

karimhamdy · October 21, 2019, 1:55pm

thank you for your support ,
but i have another question
can spark-tools also support scala currently or just python and java ?

tobias.koetter · October 21, 2019, 2:08pm

Only Java and Python.

system · June 2, 2023, 9:00pm

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.