Smaller cars actually tend to do better in heavy winds than tall, heavy vehicles, as there is less surface area for the wind to buffet.

Also, being buffeted by the wind is massively affected by the suspension design. If the car is on soft, wallowy suspension, high up in the air (think Toyota Echo), you'll be fearing for your life. However, bring the car a little lower, improve the shock absorber design, work on the steering and suspension geometry, calibrate the tires to the car (not too wide, but not too narrow), and you can significantly reduce the effect of wind.