I've found Nix to be basically the be-all-and-end-all of making Python work reasonably. Mitchell Hashimoto put out a post about how to actually do that a while ago [1].

[1]: https://mitchellh.com/writing/nix-with-dockerfiles