Yes, but there are plenty of exceptions. I know brilliantly knowledgeable and extraordinary clever people that are so socially awkward that they can't explain virtually anything.
Good question and I think you're making a valid point.
I think overall on average they would do a decent job of explaining it in writing to equally brilliant people. Not so sure about "dumbing it down" for the "others".