hello I want to delete the duplicate data at the db level, please introduce me the relevant node or workflow.

Hi @alex1368 , May be you can try something like this. For eg this is my table [5] [1] Steps Select table using DB Table Selector node Using DB Query node find out the duplicates. This SQL query is designed to identify duplicate rows in a table based on the combination of the FirstName, LastName, and Department columns, and it returns only the duplicate rows (i.e., the rows with row_num != 1). [2] Use DB Delete(Table) to delete this duplicate rows [3] My output table [6] Delete duplicate information at the db level.knwf (81.1 KB) See if it helps Regards, Yogesh

Delete duplicate information at the db level

KNIME Extensions

mlauber71 September 23, 2024, 2:47pm 4

@alex1368 if you have more complicated scenarios you can use the WINDOW function in SQL (depending on your database) to have more control about what duplicate you want to remove.