I noticed that chaining Python or R scripts is rather slow. Even when passing a tiny one-cell table, a series of 5 Python scripts takes 10 seconds to complete. R is not much better. I guess launching the Python/R environment and converting a Knime table to and from a pandas/R dataframe takes a really long time. Is there any way to speeds this up? The ancient Python Snippet node is much faster, but it converts the table into a OrderedDict instead of a pandas dataframe, and I have a suspicion that it is not entirely thread-safe. I am using Knime 3.7.0 on Xubuntu 18.04 64-bit.
My current solution is to combine the python scripts into a single node, but this makes the workflow less modular.