Merging different sheets of a Excel Workbook into one.

KNIME Analytics Platform
1

If I were to merge 12 sheets each containing roughly 65,000 rows and 47 Columns. When I tried to loop through all the sheet names using the excel reader node, it tends to fail. How would I go about to solve the problem?

2

It is not clear what specifically fail, what’s the err message? Also, did you use example?
https://hub.knime.com/knime/space/Examples/01_Data_Access/01_Common_Type_Files/05_Read_all_sheets_from_an_XLS_file_in_a_loop

3

That what I am using and it is simply never finishes.

4

Then try load 1 or 2 sheets to estimate time.

5

I am working on this with my colleague (shubhamss).
Error message:Failed to execute runnable (java.lang.OutOfMemoryError: Java heap space)

I tested with a small sample size, the workflow has no errors.

6

How can I increase the Java Heap Space for KNIME?

  1. In the KNIME installation directory there is a file called knime.ini (under Linux it might be .knime.ini; for MacOS : right click on KNIME.app, select “Show package contents”, go to “/Contents/Eclipse/” and you should find a Knime.ini). Open the file,
  2. Find the entry -Xmx1024m and change it to -Xmx4g or higher (for example).
  3. (Re)start KNIME.
7

Hi there,

you can try giving more GBs to KNIME but still the underlying library of the Apache POI project performance is limited.

Check here:

Br,
Ivan

8

This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.