First off, the government needs revenue to function. It has to tax something to get it. Taxing pollution "internalizes the externalities" and serves two goals - providing revenue for the government, and discouraging pollution.
Isn't that better than discouraging productive behavior?