I never been able to put my wallet in my back pocket. It's so uncomfortable, especially when sitting down like you said. I can't understand how other people put up with it. I always carry it in my side pocket instead. It looks weird but at least I can sit comfortably.