Connect to GCP VertexAI for Chat Agent

I am trying to do a very basic call to an LLM via GCP VertexAI. I can’t use Google AI Studio, as that is not an option for my organization, it must be VertexAI.

My service account can connect via Google Authenticator, but I will come back to this. When I connect VertexAI Connector, and set my project id, it fails to connect. I am curious if others have faced this.

It’s also odd that we have to define scope when using a service account when using Google Authenticator, as we itemize the access via the service account already. The only options for Google Authenticator are Analytics, Drive and Sheets.

Can anyone point me to what I might be missing? The service account properly matches the the project id I specified.

I am using version 5.9. Also, when I attempt to use interactive for Google Authenticator, no window pops up.

To step back, I suppose I am curious if anyone has been able to get an LLM call to work with Vertex, and if so, can you point me to an example workflow?

@Brock_Tibert An example is here but I have not tried myself

Connecting KNIME and Google Cloud is not so easy it seems too get the right combination of permissions and settings in the nodes.

My approach would be to battle it out with ChatGPT and Gemini itself positing the error message and then contacting your IT and knime support until you find the right combination. And then tell us about.

With that I was able to get some connections right but a lot of things might depend on specific settings in the service accounts and company policies.

I am not an expert on the inner workings of the Google Authenticator but I know that in order for the Vertex AI Connector to work, the Google Authenticator needs to add the custom scope `https://www.googleapis.com/auth/cloud-platform\`.

Please let us know if that resolves the problem for you.

Best regards,

Adrian

3 Likes

That did the trick. It was the custom scope. I was able to wire up a working single turn via VertexAI and my GCP Project service account.

Thanks!

3 Likes

Awesome, glad to hear it works now.

I also opened a ticket to add Vertex AI to the standard scopes, which should make this easier to configure in the future.

2 Likes

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.