Response error as "!!!!!!!!!!!!!" for the gpt4all model

It seems there is a new version of gguf that is not currently supported by the KNIME nodes - there is a ticket to fix that: AP-22323.

Also it will make sense to check the correct prompts templates of a model in order for it to work. They might differ between different LLMs.

image