Hi @hknparts,
Welcome to the forum!
As mentioned in the error message, this model is not supported by HF Inference, so the HF Hub LLM Selector cannot load it. Some models on Hugging Face are only available for local download or custom inference setups, and not via the Hugging Face Inference API.
To use this model in KNIME, you would need to:
- Download and run it locally, and
- Connect to it using the Custom LLM integration (e.g., GPT4All) rather than HF Inference.
If you want to use HF Inference specifically, choose a model that includes the “Inference API” badge on Hugging Face.
Best,
Keerthan
1 Like