Remove vice versa duplicates

Hi @ all,

I have been trying to eliminate this vice versa duplicate for a while now. But unfortunately I have no idea how to do it.
Maybe someone here can help me?

Thanks a lot
Capture

Hi @IlariaL , I hope I understood what you meant by “vice versa” duplicates here :slight_smile: :joy:

The way I understood it is ID and ID#1 interchangeable values being the same ({a,b and b,a}; {c,d and dc}), and similarly Name and Name#1 interchangeable values being the same.

So, the logic I have used is I create a sorted collection between ID and ID#1, and between Name and Name#1, that way, since they’re sorted, {b,a} will become {a,b}, and similarly, {xy,as} will become {as,xy}, and I finish off with the Dupliate Row Filter.

This is how my workflow looks like:
image

Input data:
image

Results:
image

In my example, I am not removing the duplicates, as I don’t know which one you want to keep or remove, but this is just a matter of configuring the Duplicate Row Filter to whatever you want to do:
image

You can choose which one to remove and which one to keep.

Here’s the workflow: Remove vice versa duplicates.knwf (14.4 KB)

4 Likes

Hi @bruno29a,

thank you so much! This is exactly what I needed.

1 Like

Bruno already solved your issue so kudos to him,
just in case you like to see another idea.
If you do a column aggregation and choose sorted list there you should be able to apply the duplicate row filter on that aggregated column
br

1 Like

Hi @Daniel_Weikert , Ahhhh! That was the node I was looking for!! I forgot about this one. Thanks for pointing it out :slight_smile:

I added the use of this node as another method:
image

And here’s the updated version of the workflow: Remove vice versa duplicates.knwf (23.1 KB)

3 Likes

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.