Have you tried running the full R1 model with that? People in sibling comments m... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ant6n 7 months ago \| parent \| context \| favorite \| on: Run DeepSeek R1 Dynamic 1.58-bit Have you tried running the full R1 model with that? People in sibling comments mention high end EPYCs gor a 10K machine, but I’m curious whether it’s possible to make a 1-2K machine that could still run those big models simply because they fit in RAM.

immibis 7 months ago [–]

I spent about $3000 on my machine, have the cheapest Threadripper CPU and 256GB of RAM, so no, 600GB won't fit in RAM on a $2K machine.

But everyone is using the distilled models which are much smaller.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact