> It all comes down to a big optimization/interpolation problem. Isn't what they call "Learning" just really "estimating" ?

Yes.

A mathematician will say "why do you call this 'back propagation', isn't it just matrix multiplication?" Many disciplines have different names for the same process.