Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> You can set the temperature of LLMs to 0 and that will make them deterministic.

It will make them more deterministic, but it will not make them fully deterministic. This is a crucial distinction.



That’s an implementation choice. All the math involved is deterministic if you want it to be.


It will still be nondeterministic in this context. Prompts like “Can you do X?” and “Please do X” might result in very different outcomes, even when it’s “technically deterministic”. For the human operating with natural language it’s nondeterministic.


Google is significantly less deterministic than AltaVista was.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: