Under that logic your breathing is a matter of their continued consent and lynch mobs are an expression of a democratic society. Protection of minority rights is an important function in government.