DB duplicate row filter

[89trunks]

Hi,

I was wondering is there DB Node similar to “duplicate row filter”?

I am trying to filter whole DB table and get ride of duplicate rows and keep only those where date is newest.

I want to choose let’s say Product column where Knime should find duplicate and select only row where max delivery date.

[mlauber71]

@89trunks if your database supports Window functions like RANK you can use that:

School of duplicates - and how to deal with them - H2 version – mlauber71

School of duplicates - and how to deal with them

Dealing with duplicates is a constant theme with data scientist. And a lot of things can go wrong. The easiest ways to deal with them is SQL’s GROUP BY or DISTINCT. Just get rid of them and be done. But as this examples might demonstrate this might not always be the best option. Even if your data provider swears your combined IDs are unique especially in Big Data scenarios there might still be lurking some muddy duplicates and you should still be able to deal with them. And you should be able t…