I’m looking to use KNIME to automatically sort through emails I have scraped from Let’s Extract Market Studio. The objective would be that if the Domain occurs three times or more then delete all under that domain. Sort of like deleting duplicates however some duplicates are necessary as some websites have info@website.com and then contact@website.com for example. The things that I am trying to get rid of are the masses of website emails collected when my tool goes onto Deliveroo or the Guardian or BBC and it collects all the emails from there as they use a keyword I’m searching with. Currently I’ve put this in place to split my keywords three ways as I did multiple keywords in one search. Now as I said, I am looking to delete irrelevant emails (which in my head seemed easiest way to do it: with the domain => 3 = delete all). [Screenshot of my Knime]

Delete duplicates

mlauber71 July 1, 2020, 3:44pm 8

@Wilko1806 in case you want to explore further the case of duplicates I wrote a condensed article and built a demo workflow:

2 Likes