This is just not true, it may be a factor but it's not the "only". What you have in many cases is simple market pressure: kick out the residents and transform nearly every house in the city centre into a hostel/airbnb because renting to tourists rakes you in much more money. Now residents either pay 3x 4x the price they did, or they abandon the city centre for good, leaving it little more than a playground for tourists.