Humans have to learn sight while learning speech though. I don't mean knowing that this is a dog, I mean making sense of noisy vision inputs.

So what? There's no indication that one hinders the other much, and may even improve generalization.