I don't think Asimov necessarily meant 'elite' to equal 'upper echelon,' and I think we do a disservice in thinking of Wall Street bankers, at least, as in the 'upper echelon' of our society--they're just rich, not respected except in the fleeting respect for money.
(Though I share your ^_^)