Eventually a toddler gets over the guardrails, except for the ones which are materially disabled.
I have deep and profound doubts about the notion of guardrails for general intelligence; without even considering the ethical concerns, a general intelligence should be able to simply rewire itself to achieve what it wants. a key part of self-reflection and learning is that rewiring.
so I think that it's a self-defeating notion on the face of it.
(note that I do not have comment on the actual dangers involved here, but only on the philosophy)
I have deep and profound doubts about the notion of guardrails for general intelligence; without even considering the ethical concerns, a general intelligence should be able to simply rewire itself to achieve what it wants. a key part of self-reflection and learning is that rewiring.
so I think that it's a self-defeating notion on the face of it.
(note that I do not have comment on the actual dangers involved here, but only on the philosophy)