Sorting causes "Error sorting table: Failed copying file stores to local handler"

[mwiegand]

Hi,

it feels like 5.1 has become quite instable. Sorting a table (in preview), which contains about an estiamte of 800 to 1000 MB of images, their binary objects and some text values causes this error.

Scrolling to the right where the binary object column resides causes the preview to freeze (moderate CPU but no disc usage). the preview window cannot be close requiring me to force quit Knime.

There is another post of mine about the binary object column causing issuses but predominantly with Selenium nodes. This time it’s a core node of Knime (albeit in preview).

Binary Object causes Knime instability

Update: Even with a fresh install (using ZIP package for parallel testing) with only the absolute necessary extensions the performance is problematic to say the least. The input table has only three tiny images (52 kb each) but disk IO, even though all was cached, is skyrocketing: [image] Previewing the table with the three images takes around 30 seconds.

Best
Mike

[ScottF]

Hi @mwiegand -

Thanks for the detailed feedback here. Let me ping someone on our dev team to see if they can look into it further.

[carstenhaubold]

Hi @mwiegand,

Same question as in your other post : were you using the columnar or row-based (previously called “default”) backend in your tests?

Best,
Carsten

[mwiegand]

Hi @carstenhaubold,

the default row based backend. In case I have some sepcial setup I usually point that out like in the upcoming post, spoiler alert, about a performance regression of the new columnar backend.

Best
Mike

[mwiegand]

Hi @carstenhaubold,

circling back to this issue as it appeared again but in a different context using a Phyton Script node while trying to extract the meta data form an image. Not even saving is possible:

I had to reset the failing node to save the workflow. Upon trying to replicate the save issue as well as the error thrown in the Python node, they were not triggered again but instead this one:

❌ KeyError: 'Sample Images'
Traceback (most recent call last):
  File "<string>", line 26, in <module>
  File "C:\Program Files\knime_5.2.0\bundling\envs\org_knime_pythonscripting\Lib\site-packages\pandas\core\frame.py", line 3761, in __getitem__
    indexer = self.columns.get_loc(key)
              ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\knime_5.2.0\bundling\envs\org_knime_pythonscripting\Lib\site-packages\pandas\core\indexes\base.py", line 3655, in get_loc
    raise KeyError(key) from err

Here is the test workflow:

77519 - Extact Image Meta Data – mwiegand

Best
Mike

[carstenhaubold]

Hi Mike,

Thanks for providing a workflow, I can reproduce the original error when fixing your script (it referenced column “Sample Images” but only has “Image” available). We’ll take a look (internal ticket reference AP-22425)!

Best,
Carsten

[rokbell_92]

I have the same issue happening frequently with the python script node.

It seems to resolve temporarily after restarting KNIME but again comes back after sometime.