> I’m assuming it’s like a converging vs diverging series in how well the LLM recovers from problems.
That's a really good point.
Similar causes diverging in effect, a phase change or not, depending on whether a critical feedback threshold is hit or not. That could certainly be a factor.
With increasing doses of some drugs, humans do progress from being just a bit wonky, to full on lost in space!
But I think confabulation might be on a different continuum too. We fill in recalled memories with made up details all the time. Our memory storage is lossy, associative and overlapping. Our recall is always an imperfect combination of actual incidence memory filled out by similar memories.
We must confabulate to recall. Statistically, sometimes we over confabulate.
That's a really good point.
Similar causes diverging in effect, a phase change or not, depending on whether a critical feedback threshold is hit or not. That could certainly be a factor.
With increasing doses of some drugs, humans do progress from being just a bit wonky, to full on lost in space!
But I think confabulation might be on a different continuum too. We fill in recalled memories with made up details all the time. Our memory storage is lossy, associative and overlapping. Our recall is always an imperfect combination of actual incidence memory filled out by similar memories.
We must confabulate to recall. Statistically, sometimes we over confabulate.