As someone you are referring to, though not on the spectrum, I can say confidently that eye contact has a negative impact on my following of a conversation. This is more true when the conversation requires more thought to contribute meaningfully.

Perhaps interesting is that I do have a mild form of Tourette's syndrome. Eye contact for me very quickly becomes "itchy" and there is a lot of focus required to ignore that feeling for a lengthy conversation.