I try to download some web tables and thought the Table Extractor from the Selenium Nodes is just perfect for that.
The problem is that I have a table that splits over two pages (80 entries), but the max I can show on the page is 50 entries. Then I click the “next page button” (pagination) and it shows the next 50 (or 30 in my case).
The problem I have is that I can extract the max page number and wanted to loop through that, but that seems difficult, as the TableExtractor node does not provide a WebDriver at its output.
So basically the flow I ideated
Loop Start -> Table Extractor -> check current iteration vs number of pages -> next page
does not really work as I am “looses” the WebDriver which is however required in each iteration.
I guess I am overseeing something here, maybe someone can push me in the right direction?
Thank you in advance!!!