If someone has done an action, we can say that they're responsible for that action. There's no attack in identifying responsibility or ownership, but as I explained above, I myself have often interpreted this as an attack on me, when for example, someone was pointing out to me how I was being racist.