deepseek local model config

[arddashti]

hello

I tried to run deepseek LLM on the local system, but the problem is that the model I downloaded is not displayed in the list.

[mlauber71]

@arddashti you can use local DeepSeek models with the help of ollama or GPT4All

Deepseek models supported?

@laval yes you should be able to use that for example with GPT4All and suitable .gguf models: [image] the use of a Vector store is an extra. It should also work with a suitable prompt: (just make sure you have the folder structure right where you place the .gguf files. Maybe check the whole workflow group) Claude.ai says about these .gguf models: Q2/Q3 versions are best for limited memory but may have some quality loss Q4/Q5 offer a good balance of size and quality Q6/Q8 versions mainta…

[mmrostami]

in terminal or windows powershell check if ollama is running in this link or not:
http://localhost:11434/

check here:

Deepseek_in_KNIME – mmrostami