I pretty much did the same, I started with OpenElec because my pi shipped with it, changed to raspbmc because I liked the fact it was debian-based. There really doesn't seem to be much performance difference.