Using DB Loader to Create Table in Bigquery

[Jason_Kish]

When attempting to create a table and load data into BigQuery using the DB Loader node, the Loader node executes to 10% after which I get an error: “Execute Failed: No Filesystem for scheme “file””. On the other hand, when using the DB Writer node, my table gets created and data writes to the table, albeit extremely slowly. Any insite into what is causing this error in this node?

[tobias.koetter]

Hello @Jason_Kish ,
what KNIME AP version and operating system are you using?
Thanks
Tobias

[Jason_Kish]

Hi @tobias.koetter,
I’m on version 5.4.3 running Windows 10 Enterprise

[tobias.koetter]

Hello @Jason_Kish ,
thanks for the info. I was able to reproduce the problem and will investigate further what causes it. I will get back as soon as possible.
Bye
Tobias

[Jason_Kish]

Hi @tobias.koetter,
Just wondering if you’ve been able to figure out what might be causing this issue.

[tobias.koetter]

Hello @Jason_Kish ,

the problem seems to occur only on some Windows systems. On these systems the Hadoop local file system, which is required to read local Parquet file, is not properly initialized. However so far we haven’t found a solution yet. We will continue to work on a solution and will hopefully release it with the 5.5.1 release. I will keep you posted here. I will keep you posted here.

In the meantime what you can try is install KNIME AP in another folder using the self-extracting archive (not the installer) and see if it works in the new installation.

As an alternative you can also select CSV as file format instead of Parquet

I’m sorry for the inconveniences.

Bye
Tobias

[tobias.koetter]

Hello @Jason_Kish ,
we have found a solution for the problem which will be released with version 5.5.1 and 5.4.5 of the KNIME Analytics Platform.
Bye
Tobias

[Jason_Kish]

thank you @tobias.koetter
Do you know an ETA on those version updates?

[tobias.koetter]

Hello @Jason_Kish ,
I cannot give you an exact date but it looks like as if 5.5.1 will be released by end of July. I have no date for the 5.4.5 yet. I will report here as soon as I know more.
Bye
Tobias

[Diego_Poveda]

Hello, good day, @tobias.koetter

I would like to report that I am experiencing the same error. I am working with version 5.5.0 on a Linux Ubuntu 22.04 LTS machine.

I look forward to your solution.

Regards,

[forum]

Internal ticket ID: AP-24482
Summary: DB Loader fails when connected to Google BigQuey with No FileSystem for scheme “file”
Fix version(s): 5.4.5, 5.5.1
Other related topic(s):

Bug in DB Loader Node (Parquet to BigQuery) – "No FileSystem for scheme 'file'" since v5.4.4

Hi KNIME Team, I’m encountering an issue with the DB Loader node when uploading data to a Google BigQuery table using Parquet format. This problem started occurring only after upgrading to version 5.4.4. In earlier versions (e.g., 5.4.3 and prior), the exact same workflow and configuration worked perfectly. The error message I’m receiving is: Execute failed: No FileSystem for scheme “file” This seems to indicate a problem related to how file systems are handled internally in this version whe…

Issue with DB Loader and BigQuery Integration

Hi everyone, I’m currently facing an issue while trying to use a DB Loader to load data into BigQuery. The process fails and I receive the following error: [imagen] Has anyone been through the same thing? The parameters for “schema” and “table” are controlled by variables.

[JaimeAlzx]

Hi there

I´m using Knime 5.4.5 version an looks like the Issue continues

[tobias.koetter]

Hello @JaimeAlzx ,
can you please try it with a fresh installation. Maybe the update didn’t work properly. You can do this in parallel to the current installation. Simply download the self extracting file from the download page and extract it into any folder you have write permissions. Once installed select a fresh workspace and try it again.
Thanks
Tobias