See my link to a college math study (in a separate comment thread); you can improve predictions of math skill significantly above random (50% -> 55%) chance simply based on appearance.

I was totally shocked when I saw this, but there is at least some evidence that appearance predicts more than I would otherwise expect.