Hi @Papoitema , I put a quick demo together for you. I will use Google Search as my URL.
If you do a search on google, you will notice that once you submit the search, the URL will be in the form of:
For example, if I submit a search for the word “test”, I will end up at:
Similarly if I submit a search for the word “knime”, I will end up at:
And if I submit a search for a phrase, google replaces the spaces with a + sign. For example, if I want to search for “most recent movies”, I will end up at:
Do you see a pattern here? That means that I can query a search via the GET Request by attaching my key words to
https://www.google.com/search?q= while making sure I replace spaces with +.
Here’s how the demo workflow looks like:
These are the key words I used:
And these are the URLs that got created:
This is the result:
You can then retrieve whatever info you want from the XML column.
This is obviously giving me the html code of the search results, that is why I get a whole HTML code from top to bottom (head to body). But if you are querying a site where you are supposed to get data feed, the results would be more straight forward.
Here’s the workflow:
GET Request for google search.knwf (12.6 KB)