What is the maximum data size which KNIME can process.

Hi All,

I want to process more than 50GB data using KNIME. Is it a good idea to use KNIME for the same?

Hi @nikhilk -

KNIME doesn’t have limitations on data size, so long as you have enough RAM and disk space available.

That said, what kind of processing are you trying to do? When dealing with large datasets in KNIME, sometimes it can be useful to make use of streaming, or a Chunk Loop to break the data up into smaller pieces for iterating over.

Maybe if you can provide a bit more information on your use case, the community could give you some more specific tips?

2 Likes

This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.