BigQuery DB Loader timeout in KNIME 5.4.2 behind proxy/Fiddler – works in 4.5.1

KNIME Analytics Platform
1

Hi all,

I’m trying to upload data to BigQuery using the DB Loader node. To validate the workflow, I read data from the same BigQuery dataset and simply re-upload it. The workflow uses:

  • Google BigQuery Connector

  • DB Table Selector

  • DB Reader

  • DB Table Creator

  • DB Loader

All nodes except DB Loader work fine. In KNIME 4.5.1, the DB Loader works without problems. In KNIME 5.4.2, the DB Loader fails with a timeout to oauth2.googleapis.com:

ERROR DB Loader            3:25       Execute failed: org.apache.http.conn.ConnectTimeoutException: Connect to oauth2.googleapis.com:443 [oauth2.googleapis.com/108.177.15.95] failed: Connect timed out

We’re behind a corporate proxy and use Fiddler locally. I’ve added the proxy to Fiddler in KNIME’s Network Settings, and I also set the proxy in the JDBC parameters of the Google BigQuery Connector.

Summary:

  • Proxy chain: KNIME → Fiddler (local) → internal corporate proxy → Google BigQuery

  • The same proxy configuration is used in both versions 5.4.2 and 4.5.1

  • DB Table Selector, DB Reader, and DB Table Creator work in both 5.4.2 and 4.5.

  • The DB Loader works without problems in KNIME 4.5.1. In KNIME 5.4.2, the DB Loader fails with a timeout.

Questions:

  • Did the DB Loader (or BigQuery extension) change its HTTP/OAuth client in 5.4.x and handle proxies differently than other BigQuery nodes?

  • Does the DB Loader in 5.4.2 possibly not honor KNIME’s global proxy settings and require extra properties?

  • Anyone with a similar Fiddler + upstream corporate proxy setup who has DB Loader working in 5.4.2—any tips?

Environment:

  • OS: Windows

  • Proxy in KNIME: Manual; http and https; host:localhost; port:8887; auth: No

  • Fiddler: HTTPS decryption off

Thanks for any pointers!

Kind regards

Sven

2

Hello @sknoepfler and sorry for the delay,

I have shared this internally and we will get back to you.

1 Like