I think people mostly take issue with the hypocrisy of claiming to be a paragon of free speech while censoring all kinds of things because Musk personally dislikes them.
Sure, but that changes nothing about the hipocrisy or your right to speak up against it. It's fine to point out flaws in something you're not (or no longer) a part of.