That is a great point and I wish I had added that in! It definitely wasn't comparable with that of those in power, and much of the Anti-Federalists' fading into nonexistence was due to that power imbalance. However, I would say white men lower in socioeconomic status still held far greater rights than that of, for example, slaves and women.
Rich blacks could vote in more states after independence than poor whites. And that remained the case for 50 years. Leading to the hilarious case where the first recognized black slave in the US was owned by a black man.
Regardless, offices again had property and tax qualifications in virtually all states.
A de jure right to vote often did not translate to actual access to the franchise. States often enacted barriers such as poll taxes and literacy tests, exempting anyone whose grandfather was registered to vote (i.e. not Black people, whose grandparents had been enslaved). Such discriminatory practices were not actually outlawed until the Voting Rights Act was passed a full century later.