Split your dataframe in chunks

KNIME Analytics Platform
1

I have a huge dataframe, for which I’m getting stuck in two functions, as is not able to process it (pivoting, and missing values node).

My question is, is there a way of splitting the process in several steps? Like doing a loop so it performs the function over 10% of the dataframe at once, and then concatenate the results?

2

GM @RoyBatty296
'Chunk Loop Start 'node is a candidate; Then process your data and collect the concatenated data in a ‘Loop End’ node.

BR

1 Like
3

Thank you @gonhaddock , but what if I want to split by column and not by row?

4

@RoyBatty296
It’s hard to say without seen any data… but you can try to Transpose your data before the Chunk Loop and Transpose it again just after it. then process your data.

1 Like
5

@RoyBatty296 you might try and use the

4 Likes
6

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.