LLMs operate at token level, not word. it doesn't operate in terms of "traumatic...

TZubiri · 2025-10-10T02:31:47 1760063507

I think you are confusing tokens with vectors/embedding/parameters.

king and rex (king in latin) map to different tokens but will map to very similar vectors.

magicalhippo · 2025-10-10T01:14:02 1760058842

> it doesn't operate in terms of "traumatic", "over-training", "over" or "training", but rather "tr" "aum" "at" "ic, ", etc.

And "毛片免费观看" (Free porn movies), "天天中彩票能" (Win the lottery every day), "热这里只有精品" (Hot, only fine products here) etc[1].

typpilol · 2025-10-10T03:19:38 1760066378

Weird thing I've noticed.

Some LLMs can output nerd font glyphs and others can't.

If I recall grok code fast can but codex and sonnet can't