I spent a few weeks in Japan and it was the safest I've probably ever felt.

Interestingly though there was one night I went out and my friend living in that city was glad I didn't get harassed for being gaijin - apparently the area I went out in is notorious for people being rough on foreigners (somewhere in Fukuoka close to 10 years ago)