DataBricks Env node connection to PySpark node

KNIME Analytics Platform
,
#1

I am trying to connect to databricks from KNIME, So I had used create databricks environment node and the output port(Spark Context ) is connected to PySpark Script Source node.

The output(Spark Context) of Databricks Environment node hover text shows null on databricks Cluster.
What does that really mean? No spark context is created?

image
image700×430 12.5 KB

In WF I am trying to execute the query in databricks

image
image1090×820 24.7 KB

#2

Hello,

Can you please confirm what version of KNIME Analytics Platform (AP) is being used?

Regards,
Nickolaus

#3

Hi @NDekay,

Thanks for your response.

I am using 4.1.2 .

Regards,
Mathi

#4

Hi @mathi,

thanks for reporting this. It’s a bug in the port tooltip and should not affect the context. Going to fix this in the next release.

Regards,
Sascha

2 Likes
#5

This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.