How would it not result in lower quality output? You're reducing the set of toke... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		fennecfoxy 35 days ago \| parent \| context \| favorite \| on: Meta's Llama 3.1 can recall 42 percent of the firs... How would it not result in lower quality output? You're reducing the set of tokens that may be selected to 1. The pool isn't necessarily synonyms but words that share some semantic connection to the previous word, but the selection of one word in particular can certainly impact the word that is selected next. Explain your reasoning otherwise.

otabdeveloper4 35 days ago [–]

> You're reducing the set of tokens that may be selected to 1.

Yes, reducing it to 1 token that is deemed to be the optimal token according to the model.

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact