HttpRetriever statusCode=500 error solution help for

umutcankurt · January 5, 2019, 12:24pm

Hi everyone;
I want to get data from the web page, but I can’t get it. Sample workflow is attached. I need help.

Thanks

danielesser · January 5, 2019, 2:44pm

Just had a quick look at your workflow. You are trying to fetch the below URL using KNIME’s GET Request Node and Palladian’s HttpRetriever Node: https://tenders.procurement.gov.ge/public/library/controller.php?action=search_app&page=20

Please put the URL in your browser and see what you get. The server throws an exception and responds with a 500 Internal Server Error. This is exactly what the nodes also tell you in KNIME. To to wrap up: The server-side produces an error as a result to your request. Please reach out to them to figure out what is going on on their end.

umutcankurt · January 5, 2019, 10:52pm

Hi @danielesser
The page image I want to take is as follows. If you click the link directly, but the home page does not result in a link with cookies. I’ve already tried to add it to the workflow. The page shows the normal way in my browser. But in the workflow, the cookie handles data, but no? this can cause.

umutcankurt · January 7, 2019, 6:38pm

Is there anyone who has an idea or is there any solution?

umutcankurt · February 19, 2019, 7:27pm

I still haven’t figured it out. Isn’t there anyone to help?

qqilihq · February 20, 2019, 8:33am

As already stated above by @danielesser, 500 are server-side errors. If the request is formed correctly, this is a bug or issue with the corresponding website.

umutcankurt · February 20, 2019, 10:17am

@qqilihq
Thanks for the answer, I solved with Selenium nodes. It was easier and guaranteed solution.

system · February 27, 2019, 10:24am

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.