The Matryoshka trick is really neat - there's a good explanation here: https://h... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		simonw 9 days ago \| parent \| context \| favorite \| on: Gemini Embedding: Powering RAG and context enginee... The Matryoshka trick is really neat - there's a good explanation here: https://huggingface.co/blog/matryoshka I've seen it in a few models now - Nomic Embed 1.5 was the first https://www.nomic.ai/blog/posts/nomic-embed-matryoshka

alach11 8 days ago [–]

OpenAI did it a few weeks earlier when they released text-embedding-3-large, right?

simonw 8 days ago | [–]

Huh, yeah you're right: that was January 25th 2024 https://openai.com/index/new-embedding-models-and-api-update...

Nomic 1.5 was February 14th 2024: https://www.nomic.ai/blog/posts/nomic-embed-matryoshka

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact