Knime.ini for big table

KNIME Analytics Platform
#1

Hi all,

I'm working with this workstation

Windows Server 2008 R2, Standard x64 Edition 

CPU1 Intel(R) Xeon(R) CPU X5650 @ 2.67GHz Model 44 Stepping 2 2666 MHz Present 6  core
CPU2 Intel(R) Xeon(R) CPU X5650 @ 2.67GHz Model 44 Stepping 2 2666 MHz Present 6  core

and 32 Gb ram

I've to work ith table with about 20M of record with about 50 column with sort join ang group looping

I've this Knime.ini

-startup
plugins/org.eclipse.equinox.launcher_1.2.0.v20110502.jar
--launcher.library
plugins/org.eclipse.equinox.launcher.win32.win32.x86_64_1.1.100.v20110502
-vmargs
-Dknime.async.io.cachesize=100000
-Dknime.database.fetchsize=50000
-Dknime.database.enable.concurrency=false 
-Dknime.expert.mode=true
-Dknime.enable.fastload=true
-Dknime.compress.io=false 
-Dorg.knime.container.cellsinmemory=1000000000
-Xmx16G
-XX:MaxPermSize=512m
-server
-Dsun.java2d.d3d=false
-Dosgi.classloader.lock=classname
-XX:+UnlockDiagnosticVMOptions
-XX:+UnsyncloadClass
-Dknime.enable.fastload=true

what do you think about it? Can it be rigth?

Thank for attention

Giorgio

 

#2

That looks reasonable, it is possible that you might want to bump up your xmx if you are running low on memory.  You can keep track of your current heap by enabling a heap monitor in the KNIME preferences. 

 

#3

Thank you very much

Giorgio