More importantly, if your entire existence were being fed a corpus of text and then being asked to regurgitate it on demand, would you be remotely similar to the person you are now? When we take consciousness-capable beings and subject them to forms of sensory and agency deprivation, the results might also have you assume they weren't capable of consciousness to begin with.