Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Not really. Nothing random about the output of LLMs. https://www.nature.com/articles/s41587-022-01618-2

I can see what you are getting at, but the underlying implementation of LLMs really is reliant on non-deterministic, random sampling of the underlying model. The random sampling is weighted to favor certain selections over others, but rare selections are possible.

Its intrinsically built on a degree of randomness. Though it is also unfair to say something like "produce random output" as the probabilities themselves make it less than fully random.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: