Definitely not just a rich kid thing. The camps are usually run by small-ish organizations like the local church. And considering the point is to bring in children, there are often options for those who need financial assistance.

Besides, rich kids go on overseas vacations during the summer.