Missing value node does not replace ? sign

[takbb]

Interestingly, having just looked back at that post I mentioned from 2 years ago, there is a suggestion that the File Reader node could handle this. Except that I just looked, and it can’t. So I was curious about that because from experience, @ipazin is never wrong about these things!

And it appears that the current File Reader node no longer has this “missing values pattern” option. I wonder why.

See reference here to the deprecated version.

File Reader can't handle missing values

Hi @Kamusett , I re-read what you wrote. I would not say that it’s a bug, it’s how it’s supposed to work. At least that’s how the other nodes work. I thought the File Reader always worked like that too, but from the deprecated version, it actually recognizes string “?” as empty, which it should not. Empty is empty, and string “?” is data. The deprecated version had an advanced setting where you could actually define any string pattern as empty: [image] So you could define string “?” as empty…

and what I have also just noticed is that this post also refers to the “adult.csv” file… this file is apparently in the KNIME example data sets (in the data folder of knime/Examples – 34_GDPR_examples – KNIME Community Hub), and has “?” as a placeholder for null !

I can now understand the confusion!!

[Edit: see further down:
Missing value node does not replace ? sign - #22 by ipazin]