Is that true? I thought there was a desire to move towards byte level work rathe... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		IanCal 7 months ago \| parent \| context \| favorite \| on: Large Concept Models: Language modeling in a sente... Is that true? I thought there was a desire to move towards byte level work rather than tokens, and that the benefits of tokens was more that you are reducing the context size for the same input.

fngjdflmdflg 7 months ago [–]

>there was a desire to move towards byte level work rather than tokens

Yeah, latest work on this is from Meta a last month.[0] It showed good results.

[0] https://ai.meta.com/research/publications/byte-latent-transf... (https://news.ycombinator.com/item?id=42415122)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact