Sure, and superficially what you're saying does make sense... except that it's using deductive reasoning. There are plenty of cases where people with academic credentials vote for the same people you say dumb people do. Dumb people, of course, are people who have no academic credentials, because they're only for very smart people

I recommend giving Who Voted for Hitler? by Richard F. Hamilton a read. The world is infinitely much more complex than our story-making minds would have us believe