I was using the Redfield Bert extensions and they were working fine until I installed the new Redfield Bert Nodes extensions, which creates some sort of default to use GPU (bundled config). I did want to use my GPU as I have done before in KNIME with Keras nodes (I did configure it CUDA V10.0.130). However now I am getting all sort of errors and I am unable to use the “bert model selector.” I also tried 1) using miniconda, with other enviroments that were working previously, and 2) using the option of creating an enviroment in the Bert Nodes tab on Preferences. Nothing seems to work. These are the errors that I am getting:
1)Keeps loading forever and doesn’t report error
2)ERROR BERT Model Selector 3:171 Failed to initialize LZ4 libraries. The Columnar Table Backend won’t work properly
Just an update. I uninstalled the redfield bert nodes extension and installed again.
First I tried using with the bundled installation of the redfield bert nodes, but I got this error when trying to run the “bert model selector” Execute failed: Could not initialize class org.knime.python3.scripting.Python3KernelBackend
Second, I tried creating a bert enviroment in the preferences section of Bert (redfield_bert), but it did not work either. I got the same error: Execute failed: Could not initialize class org.knime.python3.scripting.Python3KernelBackend
As said before my laptop has cuda v.10 installed properly as I have used it in KNIME before.
Last update. I noticed the problem had to with Python not starting, and that led me to a solution in the forum asking to check if the “KNIME python integration - Columnar table back end” . It was not installed so I installed it, but still nothing works. I have tried a bunch of things but nothing. The Bert model selector gives me an errors or it starts running forever. This is the last log in case it can help:
2023-05-20 23:36:51,750 : ERROR : KNIME-Worker-32-BERT Model Selector 3:888 : : Node : BERT Model Selector : 3:888 : Execute failed: An error occurred while trying to launch Python: An exception occured while running the Python kernel. See log for details.
org.knime.dl.core.DLInvalidEnvironmentException: An error occurred while trying to launch Python: An exception occured while running the Python kernel. See log for details.
at se.redfield.bert.core.BertCommands.createKernel(BertCommands.java:82)
at se.redfield.bert.core.BertCommands.(BertCommands.java:64)
at se.redfield.bert.nodes.selector.BertModelSelectorNodeModel.downloadOrCheckModel(BertModelSelectorNodeModel.java:65)
at se.redfield.bert.nodes.selector.BertModelSelectorNodeModel.execute(BertModelSelectorNodeModel.java:59)
at org.knime.core.node.NodeModel.executeModel(NodeModel.java:549)
at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1267)
at org.knime.core.node.Node.execute(Node.java:1041)
at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:595)
at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:98)
at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:201)
at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:117)
at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:367)
at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:221)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123)
at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246)
Caused by: org.knime.python2.kernel.PythonIOException: An exception occured while running the Python kernel. See log for details.
at org.knime.python2.kernel.PythonKernelQueue$KeyedPooledPythonKernelFactory.createKernel(PythonKernelQueue.java:411)
at org.knime.python2.kernel.PythonKernelQueue$KeyedPooledPythonKernelFactory.populateHolder(PythonKernelQueue.java:396)
at org.knime.python2.kernel.PythonKernelQueue$KeyedPooledPythonKernelFactory.passivateObject(PythonKernelQueue.java:390)
at org.knime.python2.kernel.PythonKernelQueue$KeyedPooledPythonKernelFactory.passivateObject(PythonKernelQueue.java:1)
at org.apache.commons.pool2.impl.GenericKeyedObjectPool.returnObject(GenericKeyedObjectPool.java:483)
at org.knime.python2.kernel.PythonKernelQueue.lambda$1(PythonKernelQueue.java:318)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.ConnectException: Could not connect to the Python process.
at org.knime.python3.DefaultPythonGateway.waitForConnection(DefaultPythonGateway.java:261)
at org.knime.python3.DefaultPythonGateway.(DefaultPythonGateway.java:192)
at org.knime.python3.DefaultPythonGateway.create(DefaultPythonGateway.java:144)
at org.knime.python3.scripting.Python3KernelBackend.(Python3KernelBackend.java:291)
at org.knime.python3.scripting.Python3KernelBackend.(Python3KernelBackend.java:240)
at org.knime.python3.scripting.Python3KernelBackendFactory.createBackend(Python3KernelBackendFactory.java:70)
at org.knime.python2.kernel.PythonKernelQueue$KeyedPooledPythonKernelFactory.createKernel(PythonKernelQueue.java:407)
… 6 more
Thank you for your feedback and detailed stacktraces. I see that you have updated CUDA to version 10.0, so I would expect problems here. Since it is recommended to go with CUDA 10.1, cudNN 7.6 and TF 2.2.0.
This issue might require investigation, so it is not going to be a quick fix. The only suggestion for you that I have is that you can try to follow the instructions written in this blog post:
In the meantime could you please provide the information about: