What is ".txt format"? I'm genuinely curious what they went with here, but don't... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		gilrain on Oct 25, 2020 \| parent \| context \| favorite \| on: Books in .txt format for AI training purposes What is ".txt format"? I'm genuinely curious what they went with here, but don't want to download 36 GB to find out. There isn't a .txt standard, is there? I would hope for UTF-8, but given the old-school, Windows-y .txt extension, it could just as easily be Windows-1252 or something. LF or CRLF line endings?

SanchoPanda on Oct 25, 2020 [–]

It looks like they are unix line endings, UTF-8, and markdown formatted.

gilrain on Oct 25, 2020 | [–]

Thanks!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact