XXY and XYY and whatnot are all variations within a sex. Sex is defined by gamete size, females produce the larger gametes and males produce the smaller gametes. In humans, this is binary and immutable.