It matters because it creates a situation where one set of people have an awful experience with someone, and another set all say "well, in my experience he's perfectly nice and would certainly never do something like that..."
I suppose the fact that they are assholes in one situation but behave respectably in another is what makes this discrimination? If they were assholes to everyone then....
I think it is an interesting thing I see with successful people that they often attribute too much of there success to their personalities and too little to luck and circumstances. This makes them believe their own bullshit about how great they are, and how bad other people are.