Troubleshooting Connection Issues with Company’s Internal Self-Hosted AI LLM

KNIME Analytics Platform
3

I tired both the API root URL and the endpoint as suggested above and its still throwing the same error.

When I execute the “OpenAI Authentication Node,” I receive the following error:
“Execute failed: API connection failed. Please make sure that your base URL ‘https://ABC-llm-coordinator-preprod.ml-5w114b15-555.apps.apps.prod5.abc.com/chat/completions’ is valid and uses a supported (‘http://’ or ‘https://’) protocol. It might also be caused by your network settings, proxy configuration, SSL certificates, or firewall rules. ”

I decide to test to find out if its a network / cert / ssl related issue instead of a node issue and i perfomed the following:

I create a python script from my same laptop and executed using the Open AI compitable base URL using this script and this is the results that i received.

import requests

# Configuration
API_URL = "https://abc-llm-coordinator-preprod.ml-5w114b15-555.apps.apps.prod5.abc.com/chat/completions"  # Replace with your server's URL
BEARER_TOKEN = "xx"  # Replace with your actual token

# Test payload
payload = {
    "model": "Meta-Llama-3.1-70B",  # or any model your server supports
    "messages": [{"role": "user", "content": "Hello!"}],
    "temperature": 0.7
}

headers = {
    "Authorization": f"Bearer {BEARER_TOKEN}",
    "Content-Type": "application/json"
}

# Make the request
response = requests.post(API_URL, json=payload, headers=headers)

# Output response
if response.status_code == 200:
    print(" Connection successful!")
    print("Response:")
    print(response.json())
else:
    print(f" Failed to connect. Status code: {response.status_code}")
    print("Response:")
    print(response.text)

I received the following error msg:

Error: HTTPSConnectionPool(host='abc-llm-coordinator-preprod.ml-5w114b15-555.apps.apps.prod5.abc.com', port=443): Max retries exceeded with url: /chat/completions (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1006)')))
In [2]:

This lead me to suspect that why the “OpenAI Authentication Node” is failing maybe due to a cert issue.

Should my next steps be to navigate to https://ABC-llm-coordinator-preprod.ml-5w114b15-555.apps.apps.prod5.abc.com where the LLM server is hosted and export the certificate into a .pem file, then proceed to add the root certificate of my LLM server to knime using this method → keytool -import -alias our_root_cert -keystore “C:\Program Files\KNIME\plugins\org.knime.binary.jre.win32.x86_64_1.8.0.252-b09\jre\lib\security\cacerts” -file our-root-cert.pem
(I am taking guideance from another post here: Adding root certificate to KNIME - #3 by kixxalot)

Like to have some advice if i am on the right track in resolving this issue? Are there are possible issues that i should consider or think about how to resolve this?

Note my runtime environment: I am using the free knime version on a laptop trying to have knime node connect to a internal LLM server within my company.