Google BigQuery Connector Node

[skondur]

I am new to KNIME and I am trying to understand what must be given as Hostname and Database name in case we want to access data from Google BigQuery.

In my workflow I plan on using a Google Authentication API Key followed by a Google BigQuery Connector. Please direct me to resources or links that can help me understand how to define these fields.

Thank you

[ScottF]

Hi @skondur -

Have you seen this recent blog post on accessing Google Big Query by @emilio_s?

https://www.knime.com/blog/tutorial-importing-data-from-google-bigquery

Check it out, and if you have additional questions, please followup here

[skondur]

Thanks for directing me to the Link @ScottF . I shall check the link. Thanks again.

[skondur]

Hi ScottF,

I tried to follow through the steps in the tutorial. To configure the Google BigQuery Connector, I have used the hostname as bigquery.cloud.google.com and Database name as bigquery-public-data. It throws an error saying access denied. I am attaching a screenshot of the error I am facing. Please let me know how to resolve these permission issues.

Thank you

[ScottF]

It look like you’re trying to create something within the bigquery-public-data, which is read only. The error message alone isn’t enough to diagnose where you might be going wrong - for me anyway, but I don’t have experience with BigQuery myself. Let me see if @emilio_s can help.

[emilio_s]

Hi @skondur
There is a mistake in the configuration of the Google BigQuery Connector node.
As database name you must provide the Project ID of your Google Cloud Platform project. You can find it in the dashboard of Google Cloud Platform.

Here is how it looks like for me.

I hope everything is more clear now

[skondur]

Hi @emilio_s,

Thank you for the reply. I tried to plug in the Project ID and execute the node. It was successful. I have another follow up question. How do we in particular access a dataset from the public BigQuery datasets?. I plan to import a table from patents-public-data --> ebb_chembl into my KNIME workflow. What nodes would you suggest using once I have Google API Connector node and Google BigQuery Connector node executed?

[emilio_s]

Hi @skondur,
as suggested in the blogpost, next step is using a DB Table Selector node.
To query the ebb_chembl database you should build a custom query like this (please mind the quote ``):

afterwards, you can add a DB Reader node downstream to import the data into your KNIME workflow.

Feel free to follow up here for further questions

[skondur]

Thank you @emilio_s. I was able to import the table into my KNIME workflow. Thanks again for helping me out.