The problem is who judges the Adams and decide that they are assholes. People are worried that the judge will not be fair and it will be biased in favor of some ideology.
Of course at some point it will not be fair. No system is and people make mistakes. The question is - is it going to be less fair / more biased than not applying the same policy.