Hey everyone,
I was wondering if we can already use the new models like R1 somehow in the KNIME LLM nodes.
Best,
Lars
PS. The Janus Pro 7B also seems to have interesting features like image creation.
Hey everyone,
I was wondering if we can already use the new models like R1 somehow in the KNIME LLM nodes.
Best,
Lars
PS. The Janus Pro 7B also seems to have interesting features like image creation.
@laval yes you should be able to use that for example with GPT4All and suitable .gguf models:
the use of a Vector store is an extra. It should also work with a suitable prompt:
(just make sure you have the folder structure right where you place the .gguf files. Maybe check the whole workflow group)
Claude.ai says about these .gguf models:
Also Ollama should be able to handle such models. You can initially download them and then use them in KNIME.
ollama run deepseek-r1:8b
If you like the results or trust the models with your data is up to you. Although everything should run on you local machine …
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.