It depends on the country and the nature of your income. If you're self-employed, generally yes. If you're a salaried employee, that part of your income is usually taxed in the country of employment* regardless of where you live. The situation also depends on whether your home country has a tax treaty with the country where you live.
*insert 1001 loopholes and exceptions here.