Memory issue running Knime 5.4.0 in batch mode under Ubuntu

I’ve been running Knime jobs in batch mode under Ubuntu for quite some time. Previously I run into problem when upgrading to 5.1 as there were a memory issue when running the columnar back end. However, installing libjemalloc2 and setting MALLOC_ARENA_MAX=1 solved this.

However, after upgrading to Knime 5.4.0 it seems there is a new memory issue. When I start Knime I only get the message below before KNIME exits without any further info.

free(): invalid size

Attempting to remove libjemalloc2 and running Knime allows Knime to start, but I get a lot of other error messages related to memory allocation for the columnar back end.

Is there a known issue related to memory allocation in Knime 5.4.0? Are there any possible fixes or workarounds to this except having to get rid of the columnar back end (which is a big job and might cause other problems)?

Sorry for the trouble. Let me ask internally to see if this is a known issue. In the meantime, could you provide a relevant sample of the KNIME log, or some of the error messages you’re seeing?

Hi @havarde,
jemalloc conflicts with the Modern UI (CEF browser) in KNIME 5.4.0, so it’s no longer supported. Removing jemalloc and setting MALLOC_ARENA_MAX=1 should control memory usage. If you still see errors, please share them. On my Ubuntu 22.04 system, the columnar backend works fine without jemalloc, so we’ll need more details to troubleshoot further.

1 Like