The main problem with pair programming to me never seems to be brought up - the simple fact that it's massively intrusive micro-management.

I want to be given a task and do it how I think best, or how I feel at the time, or at a minimum without someone staring over my shoulder.

Not having that freedom is a huge problem for some, like me.

I could flip burgers with more freedom and enjoy it more as a result.