DB Loader error with BigQuery (user account)

KNIME Analytics Platform
1

I use the generic DB Connector and Simba JDBC driver to connect to BigQuery with my Google user account:


I am able to read data from BigQuery with DB Query Reader. However, I keep getting an error when loading data via the DB Loader:
Execute failed: BigQuery project information is not available.

Any advice? Thanks in advance.

(There is no issue with a server account and the Google BigQuery Connector.)

2

Hello @weimath,

you get this error message for every table?

(Just a note that there is dedicated node for BigQuery connection - Google BigQuery Connector)

Br,
Ivan

3

Hi Ivan,

Yes, the error persists. I tried different GCP projects and BigQuery tables.
There is no issue when using the dedicated BigQuery Connector with a Service account via the Google Authentication (API Key) node.
Unfortunately, the dedicated BigQuery Connector does not support end-user authentication. In this case, I have to use my user account.

The JDBC URI used in my generic DB connector:
jdbc:bigquery://https://www.googleapis.com/bigquery/v2:443;ProjectId=MyBigQueryProject;OAuthType=1;
The error only occurs when loading data from KNIME to BigQuery.

Thanks,

4

Hello @weimath,

I see. And if using DB Insert or DB Writer do you encounter same issue or only with DB Loader?

Br,
Ivan

5

DB Insert and DB Writer don’t have the same issue. Unfortunately, they are too slow when working with BigQuery.
image

6

Hello weimath,
this is a limitation of the DB Loader node which needs to use another API to upload the data to BigQuery then then JDBC. To do so it requires additional information e.g. the project id and login credentials which it gets from the dedicated Big Query Connector node.
We investigate if we can extend the Google authentication node to also support client credentials. Would this be an option for you as well?
Bye
Tobias

1 Like
7

Hi Tobias,

Yes that would work for us.

Thanks

8

Hello weimath,
thanks for the feedback. I will keep you posted and let you know once we support client credentials.
Bye
Tobias

9

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.