How to eliminate rows if they have the same values in some columns

KNIME Analytics Platform
1

Hi All,

Looking for a help to filter with comparison of two columns. here with mentioned below examples:

Material & Plant are repeated in the below table based on the plant column i have to remove the duplicates but only to remove the duplicate plants and remove the row.

Material Material Description Plnt
50008334 IP DECT Base Station IPBS542 Ext Antenna 3001
50008334 IP DECT Base Station IPBS542 Ext Antenna 4001
50008334 IP DECT Base Station IPBS542 Ext Antenna 3510
50008334 IP DECT Base Station IPBS542 Ext Antenna 2001
51310646 PoLRE 8 port unmanaged POE switch 2001
51310646 PoLRE 8 port unmanaged POE switch 3510
51310646 PoLRE 8 port unmanaged POE switch 3001
51310646 PoLRE 8 port unmanaged POE switch 3510
51301221 Mitel 5613/14/24/34 Programmer 2001
51301221 Mitel 5613/14/24/34 Programmer 3001
51301221 Mitel 5613/14/24/34 Programmer 3510
51301221 Mitel 5613/14/24/34 Programmer 4001
4516702 LICENCE OPENLINE SIP 2 2001
50006899 Mitel 5614/34 Battery Rack Charger 3510
50006899 Mitel 5614/34 Battery Rack Charger 2001
50006899 Mitel 5614/34 Battery Rack Charger 3001
50006899 Mitel 5614/34 Battery Rack Charger 4001
51308768 StreamLine - 8 port w Dongles x2 55V 3510 Repeat in this part by Plant
51308768 StreamLine - 8 port w Dongles x2 55V 3510 Repeat in this part by Plant
51308768 StreamLine - 8 port w Dongles x2 55V 2001
51308768 StreamLine - 8 port w Dongles x2 55V 3001
51308768 StreamLine - 8 port w Dongles x2 55V 2001
51308768 StreamLine - 8 port w Dongles x2 55V 3001
51308768 StreamLine - 8 port w Dongles x2 55V 3001
51308768 StreamLine - 8 port w Dongles x2 55V 3510 Repeat in this part by Plant
51308768 StreamLine - 8 port w Dongles x2 55V 3510 Repeat in this part by Plant
51308768 StreamLine - 8 port w Dongles x2 55V 3510 Repeat in this part by Plant
51308768 StreamLine - 8 port w Dongles x2 55V 4001
51310039 H40 DECT Stereo Headset (UK/Int’l) 3001 Repeat in this part by Plant
51310039 H40 DECT Stereo Headset (UK/Int’l) 3510
51310039 H40 DECT Stereo Headset (UK/Int’l) 4001
51310039 H40 DECT Stereo Headset (UK/Int’l) 3510
51310039 H40 DECT Stereo Headset (UK/Int’l) 3510
51310039 H40 DECT Stereo Headset (UK/Int’l) 3510
51310039 H40 DECT Stereo Headset (UK/Int’l) 3510
51310039 H40 DECT Stereo Headset (UK/Int’l) 3001 Repeat in this part by Plant
51310039 H40 DECT Stereo Headset (UK/Int’l) 2001
51310039 H40 DECT Stereo Headset (UK/Int’l) 2001
51310039 H40 DECT Stereo Headset (UK/Int’l) 3001 Repeat in this part by Plant

Please refer the comment "Repeat in this part by plant " i have to remove the column.

Please help me out thanks in advance folks

2

First thought would be to try duplicate row filter node.
Alternatively do a groupb by and count the occurances. Filter all with occurance greater one and then join the grouped table to the original table and only keep rows from the original table as join result.
As a duplicate column to test the column aggregator node could be used to create a concatenation of the column relevant to the duplication identification.
br

2 Likes
3

Thanks Daniel let me try and get back to you appreciate your help

4

Hi @Raj_22 ,

A tip here is have a counter if the value have suplicated ones… the groupby node can help with it. You can see which one have duplicated codes first. Then you can fill a column with true or false to mark it.

If you have to stay only unic values per material, you can use it after again with group by node even the plnt have the same code with other products.

The duplicated node will remove rows with the same information that you set to match, so, if you set only Plnt as the key, you’ll lost some data.

You have some insights here (2 examples). Test and let us know about the results after ok?

BR,

Denis

2 Likes
5

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.