A lot of it is cost of labor. What I suspect is cheap loans to homebuilders has propped up the price of trades and secondarily materials to the point most people can't afford to build their own house in any location.

Then, depending on where you are, you have fixed costs for building in an area like geological or ecological impact statements that can be $20k or more. Too much.