This is something I have thought about as well, I think its 2 problems, notifications and filtering, I have gmail notifier but it would be nicer to see it come natively to more apps (facebook / twitter / email / comments)

and filtering which is much harder and specific to each application