I don't see why autonomous vehicles are so big. Virtually all travel is one person, ideally it would be a tiny 4 wheel electric with the sole passenger highly reclined.
Jokes aside, it seems foolish to create an entirely new class of vehicle that drives itself while completely ignoring the physics of big bits of metal.
They used a big SUV to get rough road capability, necessary for the Grand Challenge, and to have the space to rack all the equipment they needed. 13 years later, an Nvidia Jetson (a single board computer) has more computing power than their whole setup, and a medium drone can carry it.
What does autonomy have to do with it? Most regular cars would be better off as single-person vehicles; there are a few small-scale efforts in this direction (the Smart car, the G-Whiz electric car, I think BMW has an enclosed-canopy motorbike) but they largely haven't caught on.
As autonomy is implemented and refined, and safety improves dramatically, new regulatory and economic models will emerge. This will spark design innovation. No doubt both single rider and shuttle-bus options will emerge, with much lighter builds as crashes decrease.
The hangover from internal combustion is real.