The train links into Edinburgh are pretty good - I moved from central Edinburgh across to Fife and although where I live is only ~30 minutes from Haymarket it is pretty rural and property prices are much lower.

And every day you get to go over the Forth Bridge is a good day...