One version I've heard is the concern that land value will decline if neighboring property turns into a kind of holding grounds for run-down, ill-maintained old trailers.
It does seem like our vernacular in this space is ripe for change; perhaps "homes on wheels" is teasing open that door...