# Whois domain with get request

**URL:** <https://forum.knime.com/t/whois-domain-with-get-request/38682>\
**Category:** KNIME Extensions\
**Created:** [January 10, 2022, 11:06am UTC](https://forum.knime.com/t/whois-domain-with-get-request/38682 "2022-01-10T11:06:47Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![natanzi](https://forum-cdn.knime.com/user_avatar/forum.knime.com/natanzi/32/50615_2.png) [@natanzi](https://forum.knime.com/u/natanzi)\
**Post date:** [January 10, 2022, 11:06am UTC](https://forum.knime.com/t/whois-domain-with-get-request/38682/1 "2022-01-10T11:06:47Z")

</div>

Dears,

I want to find the whois info by the getting method; Although there is a python library that address this case, I want to learn how to use the get method.

note:

Domain example: natanzi.ir

URL of NIC for.IR domain: http://whois.nic.ir/WHOIS?name=natanzi.ir

![image](https://forum-cdn.knime.com/uploads/default/original/3X/8/2/82818a672d8ae37fe61239e777ea9ed05bd06084.png)

Does anybody know how it should be implemented?

[Whois.nic.ir.knwf](https://forum.knime.com/uploads/short-url/z3yARm7Go2eanRHDEs5TBW17iDi.knwf) (13.0 KB)

---

<div class="post-metadata">

**Author:** ![aworker](https://forum-cdn.knime.com/user_avatar/forum.knime.com/aworker/32/36421_2.png) [@aworker](https://forum.knime.com/u/aworker)\
**Post date:** [January 10, 2022, 12:42pm UTC](https://forum.knime.com/t/whois-domain-with-get-request/38682/2 "2022-01-10T12:42:12Z")

</div>

Dear @natanzi

Please find below a possible solution to your need:

 ![image](https://forum-cdn.knime.com/uploads/default/original/3X/f/f/ff78c2e4915db5705d59f13d1aec96a6fb9eaae1.png)

 ![image](https://forum-cdn.knime.com/uploads/default/original/3X/f/2/f2d14c2db32487ff98b4572fd825cdf2eb5c4a67.png)

[20220110 Pikairos Whois domain with get request.knwf](https://forum.knime.com/uploads/short-url/7wimf1SoJBp9kcKPm0vtBg1v26D.knwf) (187.0 KB)

Hope this helps.

Best wishes

Ael

---

<div class="post-metadata">

**Author:** ![natanzi](https://forum-cdn.knime.com/user_avatar/forum.knime.com/natanzi/32/50615_2.png) [@natanzi](https://forum.knime.com/u/natanzi)\
**Post date:** [January 10, 2022, 1:19pm UTC](https://forum.knime.com/t/whois-domain-with-get-request/38682/3 "2022-01-10T13:19:38Z")

</div>

Dear @aworker  
Many thanks, its work.,  
I have add 10 URL and get the below error, I don’t know the root cause, also its possible to send 40K URL? I mean we need to set 10ms interval maybe

```auto
ERROR HTTP Retriever 6:760 Execute failed: Row5: Error retrieving http://whois.nic.ir/WHOIS?name=izbank.ir: Exception org.apache.http.conn.ConnectTimeoutException: Connect to whois.nic.ir:80 timed out for URL "http://whois.nic.ir/WHOIS?name=izbank.ir": Connect to whois.nic.ir:80 timed out

```

---

<div class="post-metadata">

**Author:** ![aworker](https://forum-cdn.knime.com/user_avatar/forum.knime.com/aworker/32/36421_2.png) [@aworker](https://forum.knime.com/u/aworker)\
**Post date:** [January 10, 2022, 2:10pm UTC](https://forum.knime.com/t/whois-domain-with-get-request/38682/4 "2022-01-10T14:10:06Z")

</div>

Dear @natanzi

I have tried the faulty URL ("") but it worked for me and I cannot hence reproduce the error.

Having said this, one can play with the parameters:

 ![image](https://forum-cdn.knime.com/uploads/default/original/3X/3/6/36040f04bf03d147219e96ee844cf9d15c6950b8.png)

It is possible for instance to set up a ‘number of retries after error’ and a ‘fail on network error’.  
Thus, you could for instance try to increase the # of retries and to uncheck the ‘fail on network error’.

Hope this helps.

Best wishes

Ps: Thanks for having validated the solution 🙂

---

<div class="post-metadata">

**Author:** ![bruno29a](https://forum-cdn.knime.com/user_avatar/forum.knime.com/bruno29a/32/28802_2.png) [@bruno29a](https://forum.knime.com/u/bruno29a)\
**Post date:** [January 10, 2022, 3:00pm UTC](https://forum.knime.com/t/whois-domain-with-get-request/38682/5 "2022-01-10T15:00:15Z")

</div>

Hi @natanzi @aworker , the most important thing here is to create delays between the requests, or Knime will try to send 40k requests at once for 40k URLs, or you can risk getting banned from `whois.nic.ir`.

I’m not sure about the HTTP Retriever, but the GET Request node has this option embeded:

 ![image](https://forum-cdn.knime.com/uploads/default/original/3X/3/4/34c72b611b27552287ab2825a50c03ae9808ca23.png)

Delay is the delay in ms between each batch, and Concurrency means how many requests per batch.

Alternatively if you still want to use the HTTP Retriever, then use a [Chunk Loop](https://hub.knime.com/knime/extensions/org.knime.features.base/latest/org.knime.base.node.meta.looper.chunk.LoopStartChunkNodeFactory) where you can configure the batch size, and you can use the [Wait](https://hub.knime.com/knime/extensions/org.knime.features.base/latest/org.knime.base.node.flowcontrol.sleep.SleepNodeFactory) node to create the delay between each iteration of the loop.

You should check on whois.nic.ir what are the limits it allows you to send. If you respect their limits, you should not encounter any errors.

---

<div class="post-metadata">

**Author:** ![natanzi](https://forum-cdn.knime.com/user_avatar/forum.knime.com/natanzi/32/50615_2.png) [@natanzi](https://forum.knime.com/u/natanzi)\
**Post date:** [January 11, 2022, 6:27am UTC](https://forum.knime.com/t/whois-domain-with-get-request/38682/6 "2022-01-11T06:27:39Z")

</div>

Hi @bruno29a ,  
Thanks, Yes I used chunk loop and its work for 40K URL.

---

<div class="post-metadata">

**Author:** ![system](https://forum-cdn.knime.com/uploads/default/original/1X/ab3ccf34482a0329361734a18199390177204f15.png) [@system](https://forum.knime.com/u/system)\
**Post date:** [January 18, 2022, 6:28am UTC](https://forum.knime.com/t/whois-domain-with-get-request/38682/7 "2022-01-18T06:28:02Z")

</div>

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.
