Hacker News new | past | comments | ask | show | jobs | submit login

Crawlers visiting every page on your website is not the main problem with the unauthenticated web.

The amount of spam that happens when you let people freely post is a much bigger problem.




Consider applying for YC's Summer 2025 batch! Applications are open till May 13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: