Python node takes ages to transfer from pd dataframe to output table

[mlauber71]

@Zvereec1 you could try and store the data in Parquet files inside the Python node and then import the data back. Might give an idea what is going on

Python script node error when executing in the workflow only with 38M rows, but runs fine at a few million.

@RVC2023 you can check general performance settings especially your RAM (memory) so that KNIME does have enough. If you must you can split data you export (or import) from KNIME to Python into several Parquet files and (later) handle them as one big file: [image] Mor on the processing of Big Files

use the new (KNIME 4.6+) Python Script node and bundled Python version to...