Where I live, bald-faced hornets and yellowjackets are very aggressive. Yellowjackets will also build nests inside of structures, in the ground, etc. where it's sometimes very difficult to even know they are there until it's too late.

This is much different than honey bees and other types of wasps who are much less likely to attack just by being near them.