Right that's the holding, but the dicta suggests that some non-resident, non-citizens (i.e. temporary visitors) also are unprotected by the fourth amendment.

Various lower court decisions have fleshed out what constitutes "substantial connections".