Hi,
when reading from files, or data sources in general, it isn’t clear from the preview nor from the console if the encoding auto-selected by Knime matches that of the file.
Here is one example that shows that Knime clearly has chosen the wrong encoding:
Sublime text always seems to manage to open a file in the correct encoding automatically.
In order to ensure data is not getting corrupted, I’d like to suggest to:
- Add an option to auto-detect the encoding and make this default
- Add a warning in the console as well as a yellow warning message icon to the corresponding node that encoding disjoints were detected
- Fix the encoding option set on windows to Other “windows-1252” albeit OS default is recognized as “windows-1252”
Best
Mike