The answer: "it did actually not, you are not seeing the actual ram usage, becau... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		LeoPanthera on April 1, 2023 \| parent \| context \| favorite \| on: 30B model now needs only 5.8GB of RAM? How? The answer: "it did actually not, you are not seeing the actual ram usage, because the os now counts it as filesystem cache. Since #613 the model is a memory mapped file. It does not do the impossible, it's just that gnome-system-monitor does not show cached files."

jasonmp85 on April 1, 2023 [–]

This is incredibly mundane; why is this on the front page?

dagmx on April 1, 2023 | [–]

Because it’s a response to a post that had a lot of hype on the front page yesterday

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact