Where a token is roughly equal a word? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		throwayyy479087 on March 29, 2023 \| parent \| context \| favorite \| on: Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo ... Where a token is roughly equal a word?

axutio on March 29, 2023 | [–]

1,000 tokens ≈ 750 words

famouswaffles on March 29, 2023 | [–]

one token is about 3/4 words

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact