I’m a newbie currently trying to scrape website (https://dusseldorf.shopdutyfree.com/en/) subcategories from its top categories, trying to do it dynamically as some categories don’t have any subcategories and also the number of existing subcategories varies per category.
The workflow is almost done, but I don’t get correct results, which I think has to do with the wrong loop node. For instance, I get subcategories skincare, make-up and fragrance listed across all categories (new, beauty, special offers etc), although they actually belong only to 1 category (beauty).
Does someone have an idea as to which loop node I should use or if there is another problem with the workflow? Thanks a lot.
Here is the workflow to extract the sub-categories for each category using the new Webpage Retriever node (you can also use the HTTP Retriever and HTML Parser nodes instead but in that case you need to add the namespace):
thank you very much! That is very helpful, works just as I wanted. Amazing how much shorter and more effective this new workflow ist.
I have only 1 question left: could you please explain (maybe show in a screenshot) where you found the xpath? I think I found the first one for all top-categories
