Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
imsteve
on Jan 9, 2008
|
parent
|
context
|
favorite
| on:
Ask YC: Any ideas about intelligent crawlers :)
mapreduce? Just how many requests will you be making to third-party sites at once? Sounds like a good way to get blocked fast.
Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: