# Finding duplicates compagnies

**URL:** <https://forum.knime.com/t/finding-duplicates-compagnies/20704>\
**Category:** KNIME Analytics Platform\
**Created:** [January 28, 2020, 2:42pm UTC](https://forum.knime.com/t/finding-duplicates-compagnies/20704 "2020-01-28T14:42:55Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Grayfox](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/g/ecccb3/32.png) [@Grayfox](https://forum.knime.com/u/Grayfox)\
**Post date:** [January 28, 2020, 2:42pm UTC](https://forum.knime.com/t/finding-duplicates-compagnies/20704/1 "2020-01-28T14:42:55Z")

</div>

Hi everyone,

I am working on a list of compagnies and i need to check if there is duplicates compagnies in a table.

But it’s not easy to find thoose duplicated beacause there are compagnies written in different ways.  
And the list is very long, so I need to optimize the process to find duplicates.

I have tried to use the worflows of duplicated adresses but it’s not working very well.

So, if someone can help me to built the worflow to find the duplicates.

Just for example, i give you names of compagnies to show you what it’s look like.

A-2-Z Solutions  
A&B  
A&G  
a2i  
A2Z Solutions  
ABSolute  
Absolute Magic  
AC Exchange  
AC&E  
ACS  
ACS Shop  
Active  
Active Data  
C3 Development  
C3I  
EDP  
EDS  
Harvey  
HarveyOpolis

Thank you for the helping

---

<div class="post-metadata">

**Author:** ![HansS](https://forum-cdn.knime.com/user_avatar/forum.knime.com/hanss/32/6979_2.png) [@HansS](https://forum.knime.com/u/HansS)\
**Post date:** [January 28, 2020, 3:01pm UTC](https://forum.knime.com/t/finding-duplicates-compagnies/20704/2 "2020-01-28T15:01:24Z")

</div>

Hi @Grayfox

Take a look at the String Similarity node.  
 ![Knipsel](https://forum-cdn.knime.com/uploads/default/original/2X/3/3f19fafadc450632aa721be8f67de13816f3eca0.jpeg)

gr. Hans

---

<div class="post-metadata">

**Author:** ![Rich\_ard](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/r/82dd89/32.png) [@Rich\_ard](https://forum.knime.com/u/Rich_ard)\
**Post date:** [January 28, 2020, 7:11pm UTC](https://forum.knime.com/t/finding-duplicates-compagnies/20704/4 "2020-01-28T19:11:55Z")

</div>

Hi Grayfox,

I had exactly the same requirement and, after trying various options, found the best solution (although it took me a while to work out how to configure it to fit my data structure) to be this example workflow:

> **[Indexing and Searching plug-in for address database cleansing – wiswedel](https://hub.knime.com/knime/spaces/Examples/latest/02_ETL_Data_Manipulation/05_Indexing_Searching/03_Example_for_Fuzzy_Address_Matching)**
>
> This workflow demonstrates the Indexing & Searching plugin for address database cleansing. It uses fuzzy queries to identify typos in a given address data base…

### [Index and query addresses – wiswedel](https://hub.knime.com/knime/spaces/Examples/latest/02_ETL_Data_Manipulation/05_Indexing_Searching/03_Example_for_Fuzzy_Address_Matching)

Adapting this workflow helped me to identify a bunch of duplicate organisation records, albeit with some false positives, that it would have been hard and time-consuming to identify manually. If you combine this workflow with the xls formatting nodes, you can export the results into a nicely-formatted Excel sheet that groups potential duplicates into colour-coded blocks. Unfortunately I can’t share my workflow as it contains confidential data, but here’s an edited and non-confidential extract of the output.

 ![Duplicate%20organisations](https://forum-cdn.knime.com/uploads/default/original/2X/9/99b9fc3f894324c4f749b0a9319bccdcb52cb1fc.png)

Hope this is of some use,

R

---

<div class="post-metadata">

**Author:** ![mlauber71](https://forum-cdn.knime.com/user_avatar/forum.knime.com/mlauber71/32/73590_2.png) [@mlauber71](https://forum.knime.com/u/mlauber71)\
**Post date:** [January 29, 2020, 5:06am UTC](https://forum.knime.com/t/finding-duplicates-compagnies/20704/5 "2020-01-29T05:06:52Z")

</div>

In addition to the workflow mentioned by @HansS and @Rich_ard (one created by @wiswedel ) you could check out these entries about the concept of

Fingerprinting

> [@Rule Based Filter Question](https://forum.knime.com/t/rule-based-filter-question/13419/7):
>
> The idea of fingerprinting in data is that if you do not have a unique ID you create your own from various features of your data. Classic example would be you have customers but no customer ID. You would take name, surname adress area code phone number … and combine them. You could do several variations like only using the first 5 characters of a name and ‘clean’ it by removing special characters or even using a phonetic extraction to counter various styles of writing. Or from an address you…

Compare strings and adresses

> [@How to read multiple excel files in one folder?](https://forum.knime.com/t/how-to-read-multiple-excel-files-in-one-folder/9775/17):
>
> First I think it would be best if you have a new question to open a new topic, makes it easier for people to find relevant information. Then as has been mentioned [here](https://forum.knime.com/t/calculate-the-similarity-of-two-value-string/9939/2) there seems to be just the workflow you need to compare Adresses. Maybe you could adapt that: [https://www.knime.com/knime-applications/address-deduplication](https://www.knime.com/knime-applications/address-deduplication) Also if you just want to calculate the similarity of strings there is this thread:

---

<div class="post-metadata">

**Author:** ![system](https://forum-cdn.knime.com/uploads/default/original/1X/ab3ccf34482a0329361734a18199390177204f15.png) [@system](https://forum.knime.com/u/system)\
**Post date:** [July 29, 2020, 5:06pm UTC](https://forum.knime.com/t/finding-duplicates-compagnies/20704/6 "2020-07-29T17:06:57Z")

</div>

This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.
