Remove Duplicate Columns

[Gilly1985]

Hi everyone,

New to DMing and KNIME. Sorry if this a simple one!

Is there a process for checking through a large DB and removing columns that contain the same values?

for example:

A B C
1 1 1
2 2 2
3 3 3

to just:

A
1
2
3

Many thanks

[umutcankurt]

Hi; Maybe these give an idea

Duplicate column

Hi there, I need to duplicate a column ( new column has the same values). e.g. Col Duplicated Col 1 1 2 2 1 1 4 4 10 10 etc. I can’t find a duplicate column node. Any suggestions? Thanks in advance.

Duplicate rows and matching columns

The duplicate row filter generates a result column which has one of the following values for ear row: duplicate, unique, or chosen. If the row is unique, how to know which field(s) has(have) different value(s). for example, how to generate a form like as what illustrated in the attached file.New Microsoft Excel Worksheet.xlsx (8.1 KB) [Untitled]

Remove rows with duplicate values

@serendipitytech I can add one more idea to remove duplicates and ensure unique IDs using SQL (Hive in this case) and row_number() if you have to deal with a data base - or you just like using SQL script. [image]

[Gilly1985]

Er not really, I need to remove the duplicate values.

[ipazin]

Hi there @Gilly1985,

welcome to KNIME Community and KNIME itself!

Well doesn’t look so obvious and simple (and common as I haven’t seen it before) and to my knowledge there is no dedicated node for it. But you can take advantage of Duplicate Row Filter node. Only prior to that and after you are done with it use Transpose node. Should do the trick

Br,
Ivan

[Gilly1985]

Hi Ivan,

that has worked! many thanks for the help.