Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

There's a lack of clarity, but it seems likely to me that a majority of this traffic is actually people asking questions to the AI, and the AI going out and researching for answers. When the AI tools are being used like a web browser to do research, should they still be adhering to robots.txt, or is that only intended for search indexing?


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: