You only lose rights with respect to trademarks. Copyrights do not need to be consistently enforced in order to be enforceable (although if you're not consistent you'll likely have a tough time arguing significant damages)
The real problem, which plagues open source, is the US is extremely financialized, so courts are loathe to grant actual damages for cultural loss due to free stuff getting pirated. There are still statutory damages, though.
