Corrupt workflows after starting Knime with "-clean" flag in .ini file

KNIME Analytics Platform
1

I’ve already posted this issue as an extension of the topic I posted here: ERROR... Execute failed:... (Too many open files) but it’s not getting any response.

This is quite urgent as I now can’t use any of my workflows!

My Knime platform was being extremely slow for quite a while. I thought it was because I was dealing with around 100,000 row in a workflow, but even a workflow with only about 10,000 rows was also very slow. I found a solution in the knime forum to enter “-clean” in the .ini file, close Knime, and open it again. This solved the latency, but has caused a lot of new issues and producing a lot of errors.

When trying to run a Chunk Loop, it seems the loop body has executed, but the Chunk Loop Start node & Loop End node remain as “queued”. It spits out this error:

ERROR ThreadPool                      An exception occurred while executing a runnable.

I’m getting this error for multiple node including Binary Objects to Strings, XPath, & GroupBy:

failed to apply settings: com/google/common/collect/HashBiMap$KeySet

I tried to execute a metanode that is linked to our server, and I got these errors:

I tried to run a pre-existing metanode, and I got the following errors:

Blockquote
ERROR LoadWorkflowRunnable Errors during load: Status: DataLoadError: 3C_10_R10_JD 5 loaded with error during data load
ERROR LoadWorkflowRunnable Status: DataLoadError: 3C_10_R10_JD 5
ERROR LoadWorkflowRunnable Status: Warning: Super Robust HTTP Retriever - Multi URL 5:1839
ERROR LoadWorkflowRunnable Status: Warning: Column Selection Configuration 5:1839:0:1648
ERROR LoadWorkflowRunnable Status: Warning: State has changed from CONFIGURED to IDLE
ERROR LoadWorkflowRunnable Status: Warning: Column Selection Configuration 5:1839:0:604
ERROR LoadWorkflowRunnable Status: Warning: State has changed from CONFIGURED to IDLE
ERROR LoadWorkflowRunnable Status: Error: Generic Price Formatting 5:1681
ERROR LoadWorkflowRunnable Status: Error: Column List Loop Start 5:1681:827
ERROR LoadWorkflowRunnable Status: Error: Loading model settings failed: Config for key “column-filter” not found.
ERROR LoadWorkflowRunnable Status: Warning: State has changed from CONFIGURED to IDLE
ERROR LoadWorkflowRunnable Status: Warning: State has changed from CONFIGURED to IDLE
ERROR LoadWorkflowRunnable Status: DataLoadError: Generic Price Formatting 5:1947
ERROR LoadWorkflowRunnable Status: Error: Column List Loop Start 5:1947:827
ERROR LoadWorkflowRunnable Status: Error: Loading model settings failed: Config for key “column-filter” not found.
ERROR LoadWorkflowRunnable Status: Warning: State has changed from CONFIGURED to IDLE
ERROR LoadWorkflowRunnable Status: DataLoadError: Column Rename (Regex) 5:1947:829
ERROR LoadWorkflowRunnable Status: DataLoadError: Unable to load port content for node “Column Rename (Regex)”: No BufferedDataTable with ID 19824693
ERROR LoadWorkflowRunnable Status: DataLoadError: Regex Split 5:1947:824
ERROR LoadWorkflowRunnable Status: DataLoadError: Unable to load port content for node “Regex Split”: No BufferedDataTable with ID 19824694
ERROR LoadWorkflowRunnable Status: DataLoadError: String Manipulation 5:1947:830
ERROR LoadWorkflowRunnable Status: DataLoadError: Unable to load port content for node “String Manipulation”: No BufferedDataTable with ID 19824695
ERROR LoadWorkflowRunnable Status: DataLoadError: String To Number 5:1947:831
ERROR LoadWorkflowRunnable Status: DataLoadError: Unable to load port content for node “String To Number”: No BufferedDataTable with ID 19824696
ERROR LoadWorkflowRunnable Status: DataLoadError: State has changed from CONFIGURED to IDLE
ERROR LoadWorkflowRunnable Status: DataLoadError: Generic Price Formatting 5:1948
ERROR LoadWorkflowRunnable Status: Error: Column List Loop Start 5:1948:827
ERROR LoadWorkflowRunnable Status: Error: Loading model settings failed: Config for key “column-filter” not found.
ERROR LoadWorkflowRunnable Status: Warning: State has changed from CONFIGURED to IDLE
ERROR LoadWorkflowRunnable Status: DataLoadError: Column Rename (Regex) 5:1948:829
ERROR LoadWorkflowRunnable Status: DataLoadError: Unable to load port content for node “Column Rename (Regex)”: No BufferedDataTable with ID 19824708
ERROR LoadWorkflowRunnable Status: DataLoadError: Regex Split 5:1948:824
ERROR LoadWorkflowRunnable Status: DataLoadError: Unable to load port content for node “Regex Split”: No BufferedDataTable with ID 19824709
ERROR LoadWorkflowRunnable Status: DataLoadError: String Manipulation 5:1948:830
ERROR LoadWorkflowRunnable Status: DataLoadError: Unable to load port content for node “String Manipulation”: No BufferedDataTable with ID 19824710
ERROR LoadWorkflowRunnable Status: DataLoadError: String To Number 5:1948:831
ERROR LoadWorkflowRunnable Status: DataLoadError: Unable to load port content for node “String To Number”: No BufferedDataTable with ID 19824711
ERROR LoadWorkflowRunnable Status: DataLoadError: State has changed from CONFIGURED to IDLE
ERROR LoadWorkflowRunnable Status: DataLoadError: State has changed from CONFIGURED to IDLE
ERROR Column Filter 5:1946 failed to apply settings: com/google/common/collect/HashBiMap$KeySet

Any help would be hugely appreciated.

2

Hi @Nancyjay,

I am sorry you have to deal with such a frustrating error. This looks like there is an internal error when executing those nodes, which means your KNIME AP installation got corrupted. The easiest fix for you would be to download a fresh Analytics Platform from Download KNIME Analytics Platform | KNIME and import the workflows from your old installation.

This way your workflows should work again.

best,
Gabriel

2 Likes
3

Hi Gabriel,

Thank you for your response. Your solution was successful in that I’m no longer getting those ghastly errors. However, my workflows can still be very slow, which is what I was trying to solve with the “-clean” attempt. It seems to be related to a component I use which contains multiple nested loops; a Parallel Chunk Loop, a Chunk Loop, followed by a Recursive Loop.

Going by other posts I’ve seen, I think it’s an issue with Knime & MacOS. I haven’t updated my Mac to BigSur yet as I was worried it would cause visual compatibility issues with Knime. Can you tell me if Knime has yet been updated to be compatible with BigSur? If so, perhaps the issue is that Knime is a step ahead of MacOS Catalina (my current version) and updating my Mac could solve that.

Thanks,
Nancy.

4

Hi @Nancyjay

Multiple nested loops can lead to slowdowns, are you using a public component? If so can you share it with me? Maybe there is some optimization potential.
Also, you could try out the new table backend: KNIME Columnar Table Backend Boosts Performance | KNIME that might speed up your workflow.

Unfortunately you are correct, there are currently issues with KNIME AP on BigSur. We are working on fixing those issues, we expect these fixes to ship with the next KNIME AP release in the summer. Updating your mac installation should not change anything related to execution speed.

best,
Gabriel

1 Like
5

Hi,

I took your advice and have set the Columnar Table Backend as my default table backend. It does seem to use less memory which is great.

My workflows are still painfully slow for tasks that shouldn’t, and did not previously, take so long. I dusted off my old MacBook to see if it had the same issues, but it doesn’t. My old mac can get through simple workflows much quicker than my newer one. There must be some kind of corruption on the machine. Is there anything that can be done for this?

6

This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.