They say all the models were distilled from a teacher model but they didn't spec... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		YetAnotherNick 4 months ago \| parent \| context \| favorite \| on: Gemma 3 Technical Report [pdf] They say all the models were distilled from a teacher model but they didn't specify what that teacher model is. Interesting thing to hide.

LeoPanthera 4 months ago [–]

It's a safe bet that it's either one of the Gemini models or a relative of it.

YetAnotherNick 4 months ago | [–]

That's what I thought. And it could be pulicity of Gemini as well that it is so good that it can teach students say 5x faster. If it is Gemini, there isn't any reason to hide. My bet is it is some unreleased Gemma or some model.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact