I think sun position at noon/during the day would trip up any person from north if someone would ask them "point to south" while being in Australia or south hemisphere. I can imagine because of that the effect of wrong side sun coming up can be rather strong.