Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You shouldn't use the same IP to continuously scrape Amazon. Personally I use a $8/month rotating proxy service that gives me a new proxy list every hour (webshare.io if it piques your interest, I'm in no way associated with them).

Also, in my experience Amazon's "ban" comes down to solving a captcha on every request, so it's more like some mild throttling than a real ban.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: