One thing I’ve noticed though is that there does not seem a way to append to an Excel sheet.
You can write to the same Excel file, but in a new sheet. You can overwrite a sheet, but you cannot append to it.
I put something together quickly, but I’m writing to different sheets at the moment. Workflow looks like this:
Since we don’t know how many times we need to loop, I start with a Generic Loop Start, but I know I should stop once we have reached the end of the file, and we know that it is the last batch when the batch size is less than the number of rows per batch.
For a proper test, I add the iteration to the data.
A side note here: @ScottF , there seems to be a bug in the Constant Value Column. I tried adding knime’s currentIteration variable as an int:
it complains:
Somehow, it’s seeing the currentIteration variable as a String. It does not complain when I add it as a string:
==== END of Side Note ====
Continuing with the explanation, here’s what the Excel file looks like:
(So the Iteration was written as a string as you can see from the screenshot, because of what I explained in the Side note above)
As you can see, it read only 5 rows each time.
If someone can point out how to append to the same sheet, that would be helpful.
In the mean time, here’s the workflow (sample file included, and it will write to the data folder): CSV read only a few lines at a time.knwf (26.8 KB)