This reasoning confuses me. Your abdication of power cedes it to whoever's next in line. Maybe you are unsure of your ability to appropriately wield power, but that is only a good reason if you think you'd be worse than the next person in line. My attitude is that power-seekers are likely to be bad power-wielders, so you'd have to be a pretty bad power-wielder to make things better by abdication.
Great point. I'm not advocating for an anarchist utopia. I think Ursula Leguin's The Dispossessed lays out the problems with that pretty well.
We've probably all participated in organizations with ineffective leadership. I do think it's better to be a clear, decisive and consistent leader than a "cool" boss if you're participating in a power structure.
So it's not even a moral issue. It's just a personal one. I think it's rare for us to really ask if we enjoy holding power over others and whether those people benefit from it. Are there fruits of power (wealth, status) worth it? When does that change?
There is an imbalance of power across all demographics. If I step aside maybe the person who gets is traditionally more powerless. The question of whether I wield it better than them is hard to judge. There's a lot of nuance to when a good leader becomes a bad one. I think it's very difficult to judge our own working of power objectively. And of course power corrupts.
If there is a moral issue, it's just that I think a lot of our systemic power structures are archaic and ineffective at directing human potential. There will always be people craving and consolidating hierarchical power structures. I'd rather engage in organic, decentralized, emergent ones when I do participate.
Maybe this is a matter of principles for you?