Good write-up. Anyone want to give a definition of GGUF without using IBM's defi... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		trash_cat on Nov 10, 2024 \| parent \| context \| favorite \| on: Everything I've learned so far about running local... Good write-up. Anyone want to give a definition of GGUF without using IBM's definition (also appears first in my search results)?

w4 on Nov 10, 2024 [–]

I was under the impression that it was simply the file format used by llama.cpp and ggml, name inspired by the name of the author (https://github.com/ggerganov): https://github.com/ggerganov/ggml/blob/master/docs/gguf.md

He prefixes everything with “gg” (his initials).

EDIT: Confirmed: https://github.com/ggerganov/ggml/issues/220

The UF stands for Unified Format.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact