First of all, just for sake of discussion, it is not normal to try prove negative statements. In any case it is hard to make definitive arguments about phenomena observable internally, such as qualia.
Now, we can make reasonable claims that
1. we are conscious systems,
2. we are very complex physical systems, far exceeding complexity of LLMs.
3. LLM only very superficially resemble real human itelligence, not even close, hallucinate left and right, get easily off the track.
3. Higher animals, primate and espercially very low IQ people, anything that have neural networks resembling all show obvious signs of consciousness.
Emergent properties by the way do not cut, because if you squint enough you'll see that emergent properties do not exist without an intelligent observer, without intepretation. Say, emergent property of bird flocks; well the whole idea of bird flock is figment of human imagination, physical world does not have birds, let alone flocks. So consciousness can be "emergent" in typical sense of the word, it can be the result of working neural network, but it will be forever closed to analysis, as it is by definition outside of externally observable world.
Now, we can make reasonable claims that
1. we are conscious systems,
2. we are very complex physical systems, far exceeding complexity of LLMs.
3. LLM only very superficially resemble real human itelligence, not even close, hallucinate left and right, get easily off the track.
3. Higher animals, primate and espercially very low IQ people, anything that have neural networks resembling all show obvious signs of consciousness.
Emergent properties by the way do not cut, because if you squint enough you'll see that emergent properties do not exist without an intelligent observer, without intepretation. Say, emergent property of bird flocks; well the whole idea of bird flock is figment of human imagination, physical world does not have birds, let alone flocks. So consciousness can be "emergent" in typical sense of the word, it can be the result of working neural network, but it will be forever closed to analysis, as it is by definition outside of externally observable world.