Issue with DB Loader and BigQuery Integration

Hi everyone,

I’m currently facing an issue while trying to use a DB Loader to load data into BigQuery. The process fails and I receive the following error:

imagen

Has anyone been through the same thing?

The parameters for “schema” and “table” are controlled by variables.

Hello @lmmr,

and welcome to KNIME Community!

Does it work without using flow variables? If it does then you should check if you configured DB Loader properly with correct flow variables and inspect the values of these flow variables you are passing to the node.

Br,
Ivan

1 Like

It doesn’t work that way either

I did a reading test with a db query reader and works fine but the loader node does not work, I don’t know if the problem is when writing the data

@lmmr does the loader need an hdfs (Google bucket) connection to store an intermediate parquet file? I am not sure. Would have to try.

Also: is the table already there or would you need to create one.

Hi @lmmr
According to the error, what you need is the File System Port in the DB Loader, which is an additional port to the DB Loader.

Try clicking on the + sign right bellow the DB Connector, and a blue port will appear.

You should have some sort of connector to your BigQuery instance. Here I’m showing you an example using AWS S3 and Redshift connectors (I don’t have the Google connectors at the moment).

If you manage to do this, it should work.

4 Likes