I don't think shipping every week is a good idea or sustainable. At what point do you take away features that are no longer useful or don't work out? Or does the ball of mud accumulate forever?
In this case, shipping a deletion of a feature/code, would also mean shipping? As in adding new commits to codebase, not exclusively shipping new features/software?