Merging different sheets of a Excel Workbook into one.

#1

If I were to merge 12 sheets each containing roughly 65,000 rows and 47 Columns. When I tried to loop through all the sheet names using the excel reader node, it tends to fail. How would I go about to solve the problem?

0 Likes

#2

It is not clear what specifically fail, what’s the err message? Also, did you use example?

0 Likes

#3

That what I am using and it is simply never finishes.

0 Likes

#4

Then try load 1 or 2 sheets to estimate time.

0 Likes

#5

I am working on this with my colleague (shubhamss).
Error message:Failed to execute runnable (java.lang.OutOfMemoryError: Java heap space)

I tested with a small sample size, the workflow has no errors.

0 Likes

#6

How can I increase the Java Heap Space for KNIME?

  1. In the KNIME installation directory there is a file called knime.ini (under Linux it might be .knime.ini; for MacOS : right click on KNIME.app, select “Show package contents”, go to “/Contents/Eclipse/” and you should find a Knime.ini). Open the file,
  2. Find the entry -Xmx1024m and change it to -Xmx4g or higher (for example).
  3. (Re)start KNIME.
0 Likes

#7

Hi there,

you can try giving more GBs to KNIME but still the underlying library of the Apache POI project performance is limited.

Check here:

Br,
Ivan

0 Likes