There is this essentially religious notion of "free will" that physical theories have been obliged to preserve, for no objective reason. Hidden variables are inconsistent with experiment only if you demand "free will" be preserved.