[Excel reader node] Requested array size exceeds VM limit

[bruno29a]

Hi @Fovas , you can try to read the file in batches. The Excel Reader allows you to read between a range of rows:

So, you could read let’s say 40k rows at a time, and do your process and write to your new file, and then repeat the process and append to the file.

You can use a Loop to do this.

You can check this thread that I replied to earlier that can help you with how to read a file partially implement the loop:

The file is too big to be read by knime, is there any solution? Or measures

One thing I’ve noticed though is that there does not seem a way to append to an Excel sheet. You can write to the same Excel file, but in a new sheet. You can overwrite a sheet, but you cannot append to it. I put something together quickly, but I’m writing to different sheets at the moment. Workflow looks like this: [image] Since we don’t know how many times we need to loop, I start with a Generic Loop Start, but I know I should stop once we have reached the end of the file, and we know tha…

EDIT: Just to add, so you would dynamically calculate the range for the rows within the loop, and assign the range as flow variables in the Excel Reader to these 2: