@Lena_Schmid welcome to the KNIME forum. I have set up a sample workflow where a task of dealing with texts in chunks is being fed to a local LLM model. Maybe you can modify the input and the prompt and see if this can help.
Or maybe you provide a complete example with a good amount of data.