This is for LLM's which deal mainly with text. An entire book can be stored as .... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ryanackley on Aug 27, 2024 \| parent \| context \| favorite \| on: Inference is free and instant This is for LLM's which deal mainly with text. An entire book can be stored as .42 MB according to https://www.quora.com/How-many-megabytes-are-in-a-book. 424 terrabytes text is over a billion books worth of data. On the common crawl website it even says "Over 250 billion pages spanning 17 years." That's an impressive amount of information.

brrrrrm on Aug 27, 2024 [–]

LLMs can deal with more than text. Impressive today is nothing tomorrow

ryanackley on Aug 28, 2024 | [–]

The technology that allows an LLM to "see" images and video is completely different though. It's not what is being trained on common crawl.

brrrrrm on Aug 29, 2024 | | [–]

not really. embeddings are embeddings. check out llava

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact