Seems like the same idea as treating your LLM as a compiler.
When you write code in Rust and user your compiler to produce an x86 binary, you don't maintain the binary. If you want to make a change, you toss away the old binary, change your Rust code, and recompile.
That concept has been floating around a few places recently. It is wishful thinking. Your userbase won't accept constant small changes in UX, functionality, or the same bugs returning every time you update the production code. And that is what you will get if you run a non-deterministic compiler that hallucinates.
