Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Someone could run Grok-1 on a 192GB M2 Mac when a 4-bit quant is released; I'm guessing that TheBloke is already working on it.


Fairly sure the bloke hasn't created any new quants in a month.


TheBloke dissapeared near the day https://nvd.nist.gov/vuln/detail/CVE-2024-23496 was published.

Of course there has been much speculation on this, I have no more information than this that can be backed up by facts, but the timing was suspicious.


He's started a company in the UK: https://suite.endole.co.uk/insight/company/15361921-thebloke...

Interestingly registered just around the corner from where one of my relatives used to live.


And his grant funding supposedly ran out.


Was any .gguf file hosted on HuggingFace found to be crafted in a way to exploit this?


what exactly are you implying here?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: