I’d love to see two types of upvotes on the site. One for “thanks for answering/engaging” and another for “this answer is correct and high quality”. Not sure how you’d restrict or verify the votes, but I think the issue you’re pointing out is a result of only having one metric of engagement.
Slashdot also had the concept of meta-moderation, where the site's users could vote on whether a particular mod's actions were appropriate/fair or not. Presumably mods that were voted as problematic stopped getting the ability to mod.
Slashdot was in many ways way ahead of their time. I think Reddit (and even HN) could benefit from this kind of check/balance.