KAP 5.4 Table Does Not Display Properly

KNIME Analytics Platform
6

Hi @nan , I’m wondering if this is related…

Today I have been executing a long-running nested loop of about 700 iterations (on the outer loop), and when I came back to check on progress, KNIME had mysteriously stopped processing at iteration 280. There are however no errors.

As you can see in the attached screenshot, the Loop End still thinks it is queued rather than showing a red traffic light.

image
image2536×1320 206 KB

As you can see, the Node Monitor is also reporting no issues.

The problem appears to occur at the GroupBy marked in red. This has stopped because it does not think it has the required GroupBy column in the data, but this in turn appears to be a knock-on from the fact that Table Manipulator has failed to output any rows, even though it is not showing the “empty table” symbol, and in fact there are rows for it to output.

If I inspect the config for Table Manipulator though it is clear that it should be outputting data, and the data does contain the column expected by GroupBy, but for some reason it has suddenly “gone for lunch”!

image
image977×1067 57.7 KB

This isn’t the first similar issue I’ve had specifically with Table Manipulator in KNIME 5.4, but it’s the first time I’ve found something worth reporting back. Unfortunately the flow cannot be shared, but I wonder if anything like this is on your radar, or likely to be linked to the issue above raised by @rfeigel.

I looked in the KNIME log and ignoring all the noise of the WARN messages related to the general flow , KNIME suddenly hits an error, where it reports a memory leak, so it looks like a memory issue. For the record I am currently running on a pitiful laptop with only 16GB main memory, and 10G available to KNIME.

KNIME 5.4, Windows 10

here is the ERROR part of the log:


2025-01-08 11:18:43,686 : ERROR : KNIME-Worker-218-Loop End 8:156 :  : LocalNodeExecutionJob : Loop End : 8:156 : Caught "IllegalStateException": Memory was leaked by query. Memory leaked: (6208)
Allocator(ArrowColumnStore) 0/6208/74121216/1469054976 (res/actual/peak/limit)

java.lang.IllegalStateException: Memory was leaked by query. Memory leaked: (6208)
Allocator(ArrowColumnStore) 0/6208/74121216/1469054976 (res/actual/peak/limit)

	at org.apache.arrow.memory.BaseAllocator.close(BaseAllocator.java:477)
	at org.knime.core.columnar.arrow.AbstractArrowBatchReadable.close(AbstractArrowBatchReadable.java:100)
	at org.knime.core.columnar.arrow.ArrowBatchStore.close(ArrowBatchStore.java:117)
	at org.knime.core.columnar.cache.data.ReadDataCache.close(ReadDataCache.java:361)
	at org.knime.core.columnar.cache.writable.BatchWritableCache.close(BatchWritableCache.java:297)
	at org.knime.core.columnar.data.dictencoding.DictEncodedBatchWritableReadable.close(DictEncodedBatchWritableReadable.java:108)
	at org.knime.core.columnar.cache.object.ObjectCache.close(ObjectCache.java:197)
	at org.knime.core.data.columnar.table.BatchSizeRecorder$BatchSizeAugmentedReadable.close(BatchSizeRecorder.java:162)
	at org.knime.core.data.columnar.table.DefaultColumnarBatchStore.close(DefaultColumnarBatchStore.java:426)
	at org.knime.core.data.columnar.table.ColumnarRowReadTable.close(ColumnarRowReadTable.java:213)
	at org.knime.core.data.columnar.table.AbstractColumnarContainerTable.clear(AbstractColumnarContainerTable.java:218)
	at org.knime.core.node.BufferedDataTable.clearSingle(BufferedDataTable.java:972)
	at org.knime.core.node.Node.disposeTables(Node.java:1772)
	at org.knime.core.node.Node.cleanOutPorts(Node.java:1736)
	at org.knime.core.node.workflow.NativeNodeContainer.cleanOutPorts(NativeNodeContainer.java:632)
	at org.knime.core.node.workflow.NativeNodeContainer.performReset(NativeNodeContainer.java:626)
	at org.knime.core.node.workflow.SingleNodeContainer.rawReset(SingleNodeContainer.java:553)
	at org.knime.core.node.workflow.WorkflowManager.invokeResetOnSingleNodeContainer(WorkflowManager.java:5222)
	at org.knime.core.node.workflow.WorkflowManager.restartLoop(WorkflowManager.java:3806)
	at org.knime.core.node.workflow.WorkflowManager.doAfterExecution(WorkflowManager.java:3682)
	at org.knime.core.node.workflow.NodeContainer.notifyParentExecuteFinished(NodeContainer.java:689)
	at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:235)
	at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:117)
	at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:369)
	at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:223)
	at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
	at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
	at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123)
	at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246)
2025-01-08 12:32:32,959 : ERROR : main :  : KnimeBrowserView :  :  : %cerror%c Unhandled rejection:: 
      background: #c0392b;
      border-radius: 0.5em;
      color: white;
      font-weight: bold;
      padding: 2px 0.5em;
      [object Object] (source: http://org.knime.ui.java/assets/index-Bnh0E6L6.js; line: 87)
2025-01-08 12:32:32,964 : ERROR : main :  : KnimeBrowserView :  :  : Uncaught (in promise) #<Object> (source: http://org.knime.ui.java/workflow/LATAM%20-%20Read%20Contract%20Terms_e1c53f52-45fe-45d0-acbd-785ea8ade6a6/root; line: 1)
2025-01-08 13:01:52,009 : ERROR : main :  : KnimeBrowserView :  :  : %cerror%c Error captured hook ::  
      background: #c0392b;
      border-radius: 0.5em;
      color: white;
      font-weight: bold;
      padding: 2px 0.5em;
      [object Object] (source: http://org.knime.ui.java/assets/index-Bnh0E6L6.js; line: 87)
2 Likes