# HttpRetriever proxy error

**URL:** <https://forum.knime.com/t/httpretriever-proxy-error/15917>\
**Category:** Community Extensions\
**Tags:** palladian-selenium\
**Created:** [June 27, 2019, 6:32pm UTC](https://forum.knime.com/t/httpretriever-proxy-error/15917 "2019-06-27T18:32:06Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![leahxu](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/l/b2d939/32.png) [@leahxu](https://forum.knime.com/u/leahxu)\
**Post date:** [June 27, 2019, 6:32pm UTC](https://forum.knime.com/t/httpretriever-proxy-error/15917/1 "2019-06-27T18:32:06Z")

</div>

New to KNIME. I’m trying to test out web crawling using HttpRetriever and htmlparser, but I can’t get past the HttpRetriever proxy error: statuscode 407. I have configured the network setting and it works fine with GetRequest node, and that route worked. I found some similar topics but it was not clear to me if HttpRetriever could work behind the firewall. Any clarification would be highly appreciated.

---

<div class="post-metadata">

**Author:** ![qqilihq](https://forum-cdn.knime.com/user_avatar/forum.knime.com/qqilihq/32/50_2.png) [@qqilihq](https://forum.knime.com/u/qqilihq)\
**Post date:** [June 27, 2019, 10:05pm UTC](https://forum.knime.com/t/httpretriever-proxy-error/15917/2 "2019-06-27T22:05:13Z")

</div>

Hi there,

in general we rely on the KNIME-specific configuration for the proxy server, so if other nodes which access the network work just fine, the HttpRetriever should do as well.

As this is obviously not the case: Could you post an anonymized screenshot/description how your proxy configuration looks like?

Thanks!  
Philipp

---

<div class="post-metadata">

**Author:** ![leahxu](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/l/b2d939/32.png) [@leahxu](https://forum.knime.com/u/leahxu)\
**Post date:** [June 28, 2019, 1:14am UTC](https://forum.knime.com/t/httpretriever-proxy-error/15917/3 "2019-06-28T01:14:21Z")

</div>

Here is the screenshot with the proxy servers & ports masked. Thanks much for your help!

 ![KNIME_networksetting](https://forum-cdn.knime.com/uploads/default/original/2X/8/899e214f1b61adcec46039e9ca57ea3f3b3c99b4.png)

---

<div class="post-metadata">

**Author:** ![qqilihq](https://forum-cdn.knime.com/user_avatar/forum.knime.com/qqilihq/32/50_2.png) [@qqilihq](https://forum.knime.com/u/qqilihq)\
**Post date:** [July 2, 2019, 8:55pm UTC](https://forum.knime.com/t/httpretriever-proxy-error/15917/4 "2019-07-02T20:55:28Z")

</div>

I’ve just given this another try in my local environment using a squid proxy. There, everything was working fine and I can at least rule out any regressions in the HttpRetriever node.

Debugging this kind of issues is unfortunately quite tough, as it’s hard for me to simulate your exact proxy configuration. Could you probably run your workflow again and check the log file whether it contains a line which says `Using proxy: host=…` (or alternatively whether there’s a line which says `Using no proxy`, which should not be the case)? (please make sure that file logging is set to DEBUG; [here’s](https://www.schrodinger.com/kb/1763) some instructions where you find the logfile).

Btw; HTTP status `407` actually means “proxy authentication required”, but in your screenshot there’s no user/password configured for the proxy. So, sorry for repeating: Within the same environment, other functionalities which are accessing the network work fine? (e.g. the REST nodes, or also the KNIME-integrated update functionality)

If you could share the relevant parts of your KNIME log with [mail@palladian.ws](mailto:mail@palladian.ws) that would probably help to get some more insights. If that’s not possible due to privacy concerns, I fully understand.

---

<div class="post-metadata">

**Author:** ![qqilihq](https://forum-cdn.knime.com/user_avatar/forum.knime.com/qqilihq/32/50_2.png) [@qqilihq](https://forum.knime.com/u/qqilihq)\
**Post date:** [July 22, 2019, 8:05am UTC](https://forum.knime.com/t/httpretriever-proxy-error/15917/5 "2019-07-22T08:05:29Z")

</div>

@leahxu Do you have any input for me?

---

<div class="post-metadata">

**Author:** ![system](https://forum-cdn.knime.com/uploads/default/original/1X/ab3ccf34482a0329361734a18199390177204f15.png) [@system](https://forum.knime.com/u/system)\
**Post date:** [April 21, 2023, 9:39pm UTC](https://forum.knime.com/t/httpretriever-proxy-error/15917/6 "2023-04-21T21:39:23Z")

</div>

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.