Flat file parser: Problems to read files

KNIME Extensions
1

Hi,

I have trouble to read text files with the "flat file parser" of the text processing tools. If I try to read a regular single flat text file with a size about 20 mb I always catch errors that the heap exceeds its limits or that GC:OverheadLimit-error. It doesn't help if I set the heapsize to a bigger value or force the garbage collector to work further even if its using all the resources.

Are there any experiences out there regarding reading big text files into KNIME via the flat file parser? Is there some trick to parse files bigger than just some kilo bytes?

By the way: The document type definition of sdml contains an inconsistancy (see title vs titlel in http://www.tech.knime.org/files/sdml.dtd ).

Thanks in advance

Eike

2

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.