The point of the GP post is that the "w-4" token had very different results from...

		dangerlibrary on Oct 23, 2024 \| parent \| context \| favorite \| on: Probably pay attention to tokenizers The point of the GP post is that the "w-4" token had very different results from ["w", "-4"] or similar algorithms where the "w" and "4" wound up in separate tokens.