If you define recursion as a symbol referencing itself, either directly or indirectly, and if you define language as a system of relating symbols to each other, recursion is a linguistic concept, it is a concept that describes a relationship between symbols. There are good reasons to define each concept differently, but if you identify recursion empirically, recursion won't "actually" exist outside of the description of the process. It's our characterization of the process that reveals the recursive structure, even if that characterization doesn't actually exist outside of language.
> If you define recursion as a symbol referencing itself, either directly or indirectly, and if you define language as a system of relating symbols to each other, recursion is a linguistic concept
But that isn't what we mean with recursive function. We don't call this recursive:
> We don't call this recursive... it's just incrementing x
That's not a recursive function as it's written, but you could certainly consider it a form of symbolic recursion. This just isn't a very useful characterization in an iterative/imperative context. You could frame incrementing as recursive, though—this is just peano axioms/church encoding.
I agree that there's enormous value in carving out mathematics from other linguistic reasoning, but I don't see defining as something as mathematic rather than linguistic is generally useful. You use the same skills to look for incoherency in both situations, but human language is generally expected to be incoherent on some level.
Besides, a lot of what people mean when they say they're bad at math is that they're bad at arithmetic, which is honestly understandable.
> What does this mean exactly?
What does this mean exactly?