Create Databricks Environment Error

Hello

could they help?

I’m trying to make the connection between my databricks environment (community edition) and KNIME, using node Create Databricks Environment.

When trying to make the connection, the following error message was displayed.

021-10-12 16:15:57,818 : ERROR : KNIME-Worker-26-Create Databricks Environment 0:2214 :  : Node : Create Databricks Environment : 0:2214 : Execute failed: Problem with reading the data, class org.knime.bigdata.databricks.rest.libraries.ClusterLibraryStatus, ContentType: application/json.
javax.ws.rs.client.ResponseProcessingException: Problem with reading the data, class org.knime.bigdata.databricks.rest.libraries.ClusterLibraryStatus, ContentType: application/json.

knime_databricks_error.txt (6.1 KB)

Im using KNIME 4.4.1 and Databricks Community Edition

cluster conf

image

Hi @natanaeldgsantos,

the community edition of Databricks does not support all features a paid version has. Right now there are problems uploading the required libraries to run Spark Jobs from KNIME. The only way you can use the community edition right now are the DB nodes after disabling the Spark context port (see the fist option in the Create Databricks Environment configuration dialog advanced tab).

Cheers
Sascha

4 Likes

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.