Knime crashing while running association rule learner (Borgelt) node

baharehdm · May 18, 2021, 6:31am

I am trying to generate association rules with association rule learner (Borgelt) node. The data contains 250 columns.
Additionally, I try to run the knime from command line in linux. The workflow crashes on the borgelt node with this error message:

2021-05-17 16:15:30,949 : ERROR : KNIME-Worker-0-Association Rule Learner (Borgelt) 0:29 : : ItemSetMinerNodeModel : Association Rule Learner (Borgelt) : 0:29 : External executable failed (error code 137): /knime_path/knime_4.3.2/plugins/org.knime.ext.itemset_4.3.0.v202011191507/resources/executables/linux/x86_64/apriori - find frequent item sets with the apriori algorithm
version 6.22 (2016.04.09) © 1996-2016 Christian Borgelt
reading /path/knime_knime_test30278/isInput5272405140672339740.txt … [605 item(s), 31953 transaction(s)] done [0.35s].
building transaction tree … [10084 node(s)] done [0.00s].
checking subsets of size 1 2 3 4 5

2021-05-17 16:15:30,979 : ERROR : KNIME-Worker-0-Association Rule Learner (Borgelt) 0:29 : : Node : Association Rule Learner (Borgelt) : 0:29 : Execute failed: External program failed. Output: /knime_path/knime_4.3.2/plugins/org.knime.ext.itemset_4.3.0.v202011191507/resources/executables/linux/x86_64/apriori - find frequent item sets with the apriori algorithm
version 6.22 (2016.04.09) © 1996-2016 Christian Borgelt
reading /path/knime_knime_test30278/isInput5272405140672339740.txt … [605 item(s), 31953 transaction(s)] done [0.35s].
building transaction tree … [10084 node(s)] done [0.00s].
checking subsets of size 1 2 3 4 5

java.lang.IllegalStateException: External program failed. Output:
/knime_path/knime_4.3.2/plugins/org.knime.ext.itemset_4.3.0.v202011191507/resources/executables/linux/x86_64/apriori - find frequent item sets with the apriori algorithm
version 6.22 (2016.04.09) © 1996-2016 Christian Borgelt
reading /path/knime_knime_test30278/isInput5272405140672339740.txt … [605 item(s), 31953 transaction(s)] done [0.35s].
building transaction tree … [10084 node(s)] done [0.00s].
checking subsets of size 1 2 3 4 5

at org.knime.ext.itemset.nodes.miner.ItemSetMinerNodeModel.execute(ItemSetMinerNodeModel.java:299)
at org.knime.core.node.NodeModel.execute(NodeModel.java:747)
at org.knime.core.node.NodeModel.executeModel(NodeModel.java:576)
at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1245)
at org.knime.core.node.Node.execute(Node.java:1025)
at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:558)
at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:95)
at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:201)
at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:117)
at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:334)
at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:210)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123)
at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246)

I also tried to reduce the number of columns in the data to 72 columns but still I get the same error message:

021-05-14 14:40:40,368 : ERROR : KNIME-Worker-0-Association Rule Learner (Borgelt) 0:29 : : ItemSetMinerNodeModel : Association Rule Learner (Borgelt) : 0:29 : External executable failed (error code 137): /knime_path/knime_4.3.2/plugins/org.knime.ext.itemset_4.3.0.v202011191507/resources/executables/linux/x86_64/apriori - find frequent item sets with the apriori algorithm
version 6.22 (2016.04.09) © 1996-2016 Christian Borgelt
reading /path/knime_knime_test31169/isInput4301447861624250268.txt … [605 item(s), 31953 transaction(s)] done [0.37s].
building transaction tree … [10084 node(s)] done [0.00s].
checking subsets of size 1 2 3 4 5

2021-05-14 14:40:40,378 : ERROR : KNIME-Worker-0-Association Rule Learner (Borgelt) 0:29 : : Node : Association Rule Learner (Borgelt) : 0:29 : Execute failed: External program failed. Output: /knime_path/knime_4.3.2/plugins/org.knime.ext.itemset_4.3.0.v202011191507/resources/executables/linux/x86_64/apriori - find frequent item sets with the apriori algorithm
version 6.22 (2016.04.09) © 1996-2016 Christian Borgelt
reading /path/knime_knime_test31169/isInput4301447861624250268.txt … [605 item(s), 31953 transaction(s)] done [0.37s].
building transaction tree … [10084 node(s)] done [0.00s].
checking subsets of size 1 2 3 4 5

java.lang.IllegalStateException: External program failed. Output: /knime_path/knime_4.3.2/plugins/org.knime.ext.itemset_4.3.0.v202011191507/resources/executables/linux/x86_64/apriori - find frequent item sets with the apriori algorithm
version 6.22 (2016.04.09) © 1996-2016 Christian Borgelt
reading /path/knime_knime_test31169/isInput4301447861624250268.txt … [605 item(s), 31953 transaction(s)] done [0.37s].
building transaction tree … [10084 node(s)] done [0.00s].
checking subsets of size 1 2 3 4 5

at org.knime.ext.itemset.nodes.miner.ItemSetMinerNodeModel.execute(ItemSetMinerNodeModel.java:299)
at org.knime.core.node.NodeModel.execute(NodeModel.java:747)
at org.knime.core.node.NodeModel.executeModel(NodeModel.java:576)
at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1245)
at org.knime.core.node.Node.execute(Node.java:1025)
at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:558)
at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:95)
at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:201)
at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:117)
at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:334)
at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:210)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123)
at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246)

I was wondering if there is any limitation to borgelt node with the number of columns in the data.
Please help me to find a solution for this problem (how can I run borgelt node with 250 columns without crashing)
Thanks in advance.

ScottF · May 25, 2021, 3:18pm

Hi @baharehdm -

A few questions for you:

Does the Association Rule Learner (Borgelt) node fail only when running from the command line, or does it also fail when running in the KNIME AP GUI?
How much memory do you have dedicated to KNIME in the knime.ini file? Have you tried increasing it?
Do you have a dataset and/or example workflow you can share that reliably reproduces the problem? If so, can you upload that here so I can share it with the developers?

Thank you!

baharehdm · June 7, 2021, 9:44am

Hi,
Thank you for your reply!

The node is running with 26 columns from GUI successfully but for more than 26 columns it will fails both through the command line and GUI.
yes we have tried to increase the memory from 56 GB to 64 GB but still it is failing.
we do not have a similar workflow or dataset that have the same problem.
Thanks.
Br,
Bahareh

ScottF · June 8, 2021, 7:29pm

Hi @baharehdm -

Would it be possible for you to post your workflow, along with some sanitized data that recreates the problem? That way we could try to reproduce it on our end and see what out options might be.