Unfortunately I agree with you. I try to do that, but too many sites are abusive. If a site said "hey, we see you block ads, please unblock, we only use small text ads", I'd unblock right away. Most of the time though, after I unblock a site, I immediately have to re-block it.
Personally I find that "begging" annoying for sites that I almost never use, like Pastebin. I consider it for sites I use more often, but I agree with you that most of the time I end up turning it on again, ads just lag the site and are obtrusive.