Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Ooof, maybe a write up is in order? An opinioned blog post? I'd love to know more.
 help



As noted by others, the scrapers do not seem to respond to rate limiting. When you're being hit by 10-100k different IP's per hour and they don't respond to rate limiting, rate limiting isn't very effective.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: