I'm going further to say that every investing is speculative in itself, because investing is the activity of buying an asset, speculating that there will be a return.
while that's true, it's not black and white. The invested asset produces output. This output is useful, and speculative demand of that asset will, in normal circumstances, produce more of that output due to the pressure to increase the number of those assets.
Housing is not different. Except that there are some people who would prefer to limit the builds of new housing.