Hello,
I am a beginner for KNIME. I met a problem in reading multiple csv files and merge them into one big csv file.
The following is what I used. A loop to import all csv files under folder
Hello,
I am a beginner for KNIME. I met a problem in reading multiple csv files and merge them into one big csv file.
The following is what I used. A loop to import all csv files under folder
Sorry, I click wrong and upload the question before finish it.
I got the error when I run the workflow,
From the configuration of File Reader, I can see it was recognized as a double number
Any tips to solve this problem will be very appreciated.
Thanks and regards
Mei
Hi @Meihong
Welcome to the KNIME Forum community!
Does this error happen right away when reading the first file, does it happen when reading another file, or does it happen in de Loop End node?
When not all files have an identical set of columns the Loop End will stop on a situation like this if you use the default configuration.
The default configuration of the Loop End node looks like this:
When you have changing inputfiles, you could tick the last two tickmarks to read all of them into one combined result.
Hi JanDou,
Thank you JanDuo
This error happened after running for a while when reading one group of data files which after you mentioned I noticed that their structure is different with other groups data (the order of two columns data are switched).
The reading problem could be solved by click last two tick marks in Loop End as you suggested, but I think it would be better that the data structure be changed to the same before read and merge those csv files.
Thanks again for your great help!
with 4.2 you can read multiple (CSV) files without the need of a loop.
How?
The preview should show the final structure of the table. In case the files structure is changing go to the advanced settings tab and adapt the Spec merge mode to Union
If you’re running into any trouble please let me know.
Best
Mark
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.