I agree that's most people's problem, but it's now mine. I've tried to think about effective altruism from first principals. For me, I can rationally understand effective altruism and why it's attractive. I even believe people that follow it (and actually do good) may in some sense be "better" people than me. But it none the less rubs me the wrong way and I can't follow it, so I've tried to understand why.