Python Snippet

Community Extensions
1

Hi,

Python Snippets appear to operate on entire tables, how does one handle large table e.g. millions of records - with chunk loop start / loop end, or some other method?

Cheers,

Steve.

2

Hi Steve,

I would think that the python server can handle large tables as well. If not (e.g. momory issues) then you could chunk the table into smaller tables using chunk loop start, if the data is independent of rows for python snippet. If the data needs to be processed as group of rows use group loop start. If you need all data (e.g. devide all rows by maximum value of a column) then it becomes complicated. May be flow variables could help in this case!?

See here: http://tech.knime.org/forum/r-scripting/how-to-access-a-special-flow-variable-in-the-r-snippet

Best regards,

Martin

 

 

 

 

3

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.