I'm being hit with 300 req/s 24/7 from hundreds of thousands of unique IP's from... | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

		spiderfarmer 8 days ago \| parent \| context \| favorite \| on: Miasma: A tool to trap AI web scrapers in an endle... I'm being hit with 300 req/s 24/7 from hundreds of thousands of unique IP's from residential proxies. I can't rate limit any further without hurting the real users.

		help

cowboylowrez 7 days ago | [–]

Yeah real users are just as hosed as the small sites. I get blocked simply because of the netblock I browse from.

oasisbob 8 days ago | [–]

Yeah, IP-based rate limits are nearly ineffective these days.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact