Well the argument that "prisoners should be expected to do the same things non-prisoners do" really breaks down when you acknowledge that their circumstances are fundamentally different from those outside of prison.

And as for why freedom to choose their job should be different, we sort of agreed as a society quite some time ago that slavery is wrong.