There are actual studies. Lots of professional athletes were in the older part of their cohort when they were younger. So the effect Terr_ described seems to outweigh the one you describe.