Clothing communicates information. Although this information is highly contextual, it is still information.

Understanding that people judge you by how you dress isn't snobbery, it's accepting reality.