You could say the same thing about Muslims and terror attacks. Using your logic, I could point to them and terrorist actions committed by those who identify as Islamist and use it to justify acts against innocent Muslims pushing those innocents to extremist factions within Islam.

You don't help the issue by justifying ostracisation and bullying of those who are unable to seek female/male attention, it only pushes them to the extremes and extreme acts are what they commit in response.