DATABRICKS(dbfs) file download/ read into knime

Hi Team,

I had connected to Databricks using DBFS node and got the list of files available under dbfs location.

I need to read the csv files from dbfs to knime. When i tried to use CSV Reader node I am getting below error.

WF

Any help will be really helpful for reading the csv file from DBFS location into knime

Hello mathi,

currently you can not read a CSV file directly from DBFS. You first need to download it locally and then read the downloaded file into KNIME. Please have a look at this workflow for a related example.

We are currently implementing a complete new file handling framework for KNIME which will allow you to read/write directly from/to various file systems including DBFS. However we do not have the corresponding Databricks connector as of today but it is planned for the winter release. So please stay tuned.

Bye
Tobias

4 Likes

Thanks for the response @tobias.koetter.

  1. But i need to make the file downloadable to the user using FileDownloadWidget.
    In that case is there any way to make the file downloadable to user from DBFS location?

  2. And while trying to pass the path of the downloaded csv file, I am getting error. Is there any efficient way to make the file downloadable to the user from knime workspace location.