Remove Duplicate Columns

[umutcankurt]

Hi; Maybe these give an idea

Duplicate column

Hi there, I need to duplicate a column ( new column has the same values). e.g. Col Duplicated Col 1 1 2 2 1 1 4 4 10 10 etc. I can’t find a duplicate column node. Any suggestions? Thanks in advance.

Duplicate rows and matching columns

The duplicate row filter generates a result column which has one of the following values for ear row: duplicate, unique, or chosen. If the row is unique, how to know which field(s) has(have) different value(s). for example, how to generate a form like as what illustrated in the attached file.New Microsoft Excel Worksheet.xlsx (8.1 KB) [Untitled]

Remove rows with duplicate values

@serendipitytech I can add one more idea to remove duplicates and ensure unique IDs using SQL (Hive in this case) and row_number() if you have to deal with a data base - or you just like using SQL script. [image]