> We don't know what "intelligence" means, but we know it isn't matrix multiplication

What makes you believe “intelligence” can’t emerge from lots of matrix multiplications? Unless you believe in some more mystical explanation, human intelligence is just electrochemical processes not that unlike computers.