Score:0

Can many connections cause dns lookup or request timeout?

ar flag

I'm running crawler on my company's internet. 10 raspberry pi * 45 crawlers each, 2 desktops * 70 crawlers each

These processes are sending requests 24/7.

3~5% of packets are getting lost. This is affecting queuing system heavily.

I'm using my internet company's wifi router and Ubiquiti Unifi 24-port PoE switch.

The router has a quad-core CPU and 512 MB RAM.

Can these many requests cause packet loss?

Zareh Kasparian avatar
us flag
if i understood your question correctly, then my answer is: if all the requests are getting NAT to a single IP and are sent to your ISP, then this might be a cause. since ISPs can limit concurrent sessions from a Single IP toward their services.
startergate avatar
ar flag
@ZarehKasparian that could be my problem! I will try multi wan routers.
mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.