Database dataset larger than RAM size

KNIME Analytics Platform
1

Hello,

I am new to Knime and would like to know if the Knime tool allows one to run Data Mining / Machine learning algorithms on a data set (coming from a database) that is larger than the amount of RAM available for Knime on the PC?

So, for example, if I have a Postgresql database with 20 GB of data. And I am running Knime on a PC with 16GB of RAM. Can I run a classification algorithm like a Decision Tree or Logistic Regression on this dataset? Or does my dataset have to be able to fit entirely into RAM, for Knime to be able to pocess it?

Thanks,

Dan

2

Hi Dan,

no, the data does not have to fit into the memory.

We are staying inside the memory as long as we are able to do so, if not, we are starting to buffering on disk.

Best, Iris