Clicker Node to remove Privacy Settings notice

[Paul_K]

Hi

I’m trying to build a web scraper workflow but I’m stuck on the Clicker node to remove the privacy setting notice.

Using a Web Interaction node, navigator node and then a clicker node. Selecting Class name as the Accessor method and then sc-dcJsrY fwIyOl in the Accessor query but the execution fails because it can’t find the element on the current page.

The website is https://www.englandsquash.com/

Any help would be very much appreciated. I’m new to Knime and learning as I go along.

Thanks
Paul

[thor_landstrom]

Hey @Paul_K,

So those cookie pop ups can sometimes be a bit tricky as they are typically generated through JS, which is probably why the clicker cannot find it. Now there are nodes that can handle this such as the Selenium Nodes.

I would take a look at the following thread for more info on it:

Scraping an AngularJS Website Post Load

Thanks for the pointer @ScottF! @mpfeifer14 The HTTP Retriever (or the GET Request node) or any other techniques will just download the static HTML will thus not be of any help, as AngularJS requires a JavaScript environment, which is just available in a JavaScript-capable web browser. Without that, you’ll see the website as shown in an ancient browser without JavaScript (which means, placeholders instead of the actual content). So at the end this is not a question of the right XPaths, but the …

Hope this helps,
TL