what actually are the consequences of ignoring robots.txt (apart from DDOS)? hav... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		swyx 65 days ago \| parent \| context \| favorite \| on: Cloudflare Introduces Default Blocking of A.I. Dat... what actually are the consequences of ignoring robots.txt (apart from DDOS)? have any of these cases ended up in court at all?

v5v3 64 days ago [–]

BBC recently served a cease and desist on perplexity to stop, and delete all existing.

https://www.bbc.co.uk/news/articles/cy7ndgylzzmo

So an ai company can just be naughty till asked to stop, and then exclud that one company that has the financial resources to go legal.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact