Selenium Nodes

[qqilihq]

Hi Sezgin,

we’ve been in touch via email this afternoon – I’ll answer this here.

To familiarize yourself with the Selenium Nodes, I suggest to have a look at these entertaining and educational videos which I cannot recommend enough, by two power users of the nodes, @kowisoft and @armingrudd:

1. https://www.youtube.com/watch?v=KcTi6DhjnRg
2. https://www.youtube.com/watch?v=HHPbOaM0cW4
3. https://www.youtube.com/watch?v=w2_jpZxoQqk

Then, here’s a more in-depth article by @armingrudd where he explains different aspects in detail:

https://blog.intellacct.com/rule-the-web-with-selenium-nodes-in-knime-eceda86f9a99

What’s generally helpful as well is the existing threads in the Selenium Nodes subforum which you find here – it’ll lead you to some hidden gems like this one, which you can surely adapt to your specific problems:

Selenium Nodes: How to scroll within a section?

Hi KNIMErs (and webcrawlers hahaha), I am working on a workflow to screen the job postings on LinkedIn automatically. I managed to log in and search for results and I also manage to extract the required properties using XPath (thanks to @qqilihq ) But this specific page has a scroll bar within a section (see screenshot below). I tried to use the “facebook approach” that is share on the Selenium Nodes website (Execute JavaScript with scroll to bottom) but this does not seem to work when the scr…

Several example workflows using the Selenium Nodes are available on NodePit, the most comprehensive search engine for KNIME nodes and workflows: selenium — NodePit

I hope this helps to get started – keep me posted how it goes! If you require more in depth support, please post a workflow which shows your current progress and describe where you’re having trouble.

Best,
Philipp