> *multi token prediction of sufficient length* Is multi token prediction the sa... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		mdp2021 6 months ago \| parent \| context \| favorite \| on: Large Concept Models: Language modeling in a sente... > multi token prediction of sufficient length Is multi token prediction the same as predicting the embedding of a complex token (the articulation of those input tokens in a sentence)?

blackeyeblitzar 6 months ago [–]

To be honest I don’t know. Maybe the only way to know is to build and measure all these variations.

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact