I am currently trying to build a KNIME workflow to extract Job Descriptions from Webpages. This works well for most webpages, however, when I try extracting the description from any of the job postings on glassdoor it just results in an empty column and looking at the Xpath node it appears that the job description information is not in it (and not more than 2000lines). Here is an examplary link:
I have done this using the selenium nodes which appears to work.
My questions now is:
Where can I use the HTTP Retriever and where do I need to use Selenium nodes to capture content off a webpage?
Thank you for your help!