The ones you really need to watch out for are:

Red Wasps. Contrary to what that article say's, they hurt like a bitch!

Yellow Jacket

Hornet

Not to say that other's aren't just as bad, but those are the most common (at least around here) to watch out for.