I agree with where you're going. I've struggled to find the words to describe this correctly - especially that the current brute force approach of bazillion matmul operations being a mock up of intelligence but not intelligence itself perhaps. At least not a good form of intelligence.

I haven't found any thing in the web about the term geometric intelligence. I recommend you write about this