Similarity search within customer_code

[mlauber71]

@Vaish_navi I have a meta collection about string similarity and address deduplication you might want to take a look:

address deduplication, string similarity and fingerprinting (a collection) –...

Here is an example matching strings without ground truth. Since you have a customer number that should help.

Fuzzy match rows in one column

@robvp I once created this workflow that would group addresses without a ground truth against which to match. Maybe you can adapt that. If you apply this it looks something like this: [image] You can edit the threshold which would constitute a similarity (Similarity Search – KNIME Community Hub) and maybe also configure the method. [image] If you set the threshold to 0.33 (instead of 0.25) the result would be this: [image] What you could do would be to try change the order of the wor…

Then if you have additions to strings you might think about using only a part of each string (since the customer number might provide enough unique value):

Rule Based Filter Question

The idea of fingerprinting in data is that if you do not have a unique ID you create your own from various features of your data. Classic example would be you have customers but no customer ID. You would take name, surname adress area code phone number … and combine them. You could do several variations like only using the first 5 characters of a name and ‘clean’ it by removing special characters or even using a phonetic extraction to counter various styles of writing. Or from an address you…