Recurrent Problem: Reading text files with changing format and schema

[mlauber71]

@kienerj you could try and import a file in one column and try to determine the separator.

It would be good to know what kind of problems can occur with the file. Is it short lines? Or varying separators. It is difficult to cover all cases in a node.

Not reading all Commas in "Column delimiter"

@Le18BR I built a workflow that would remove leading and closing quotation marks (if a ‘legitimate’ double quotation is in the first or last column the workflow will have to be modified). The idea ist to read the CSV as one string in one column. Clean the columns according to several rules, export it again as CSV and then read the thing back into KNIME as a ‘clean’ CSV. The R Readr package should be able to handle double escapes but it did not work immediately. Again my recommendation stands: …