Hacker News new | past | comments | ask | show | jobs | submit login

Having your main pc as an LLM rig also really sucks for multitasking, since if you want to keep a model loaded to use it when needed, it means you have zero resources left to do anything else. GPU memory maxed out, most of the RAM used. Having a dedicated machine even if it's slower is a lot more practical imo, since you can actually do other things while it generates instead of having to sit there and wait, not being able to do anything else.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: