This is exactly my thoughts when I hear people complaining that they pay more tax as high earners because they're "worked hard" for the money and to get there.

Hard work is relative and people are working very hard at all salary levels. There are many other constructs which are the true reasons behind how much people earn.