Empty results / 429 status using WebDriver on hotel website

[bluebottle]

I am trying to run this website (https://www.hyatt.com/ ) on the WebDriver, but once it’s run, I get an empty page + 429 status on Chrome.

I assume the issue is bot detection (the site uses Kasada and maybe others too) and I have tried the various different snippets available in the WebDriver settings but all result in the same empty page.

Any ideas on how I can get around this? I am not trying to do anything “en masse” - I’m iterating through a small number of searches/pages so it’s not like I am bombarding the site with requests.

Any ideas on how to get around this?

[bluebottle]

It looks like fgsantos has tried similar and got some suggestions from qqilihq a couple of years ago. I tried these but it’s still giving the same result.

Help with 429 error on website

Hi, I am trying to run this website (https://www.hyatt.com/) on the WebDriver, but once it’s run, I get an empty page + 429 status on Chrome. If I try to reload, or type the website again in a different tab it still doesn’t work. If I run it on a regular Chrome window it loads normally. I found this tool that is supposed to work with Python, is there anything similar supported for Knime? Thanks!

[qqilihq]

Did you check:

Announcement: Selenium Nodes 5.6 released

Been a while, Today we released Selenium Nodes version 5.6 - as there‘s no v5 thread yet, here’s a summary of the more and less recent highlights to follow our traditions: (5.6) Solve Image Captcha: New node to solve plain image captchas using the 2Captcha API (5.5) New, highly experimental utilities for running “undetected” – install via feature Undetected Chrome Utilities. It consists of a dedicated “undetected“ Chrome WebDriver and a set of nodes: Disconnect WebDriver, Reconnec…

[bluebottle]

Thanks - yes I did check that post and a couple of other related discussions. I got the same results when using the Chrome for Testing (bundled, undetected) BETA setting.

Anything else you can suggest?

Thanks for your assistance.

[qqilihq]

Can you share your workflow, reduced to the essentials?

[bluebottle]

Certainly - https://file.io/42qbh2aOgrXt.

URL

[qqilihq]

Thank you!

I just tried this locally and I can successfully circumvent the 409 error, display and interact with the webpage using the techniques described here. Please have a close look at the instructions given there, it will require some more steps than just selecting the “Undetected” WebDriver.

If you require additional input, feel free to get in touch at mail@seleniumnodes.com

-Philipp