I agree that calling something a "Conspiracy Theory" is basically name-calling. Calling something conspiracy theory doesn't tell us much if anything about what is true or not.
But many times it's justified name calling. Because it's not the conspiracy in the theory that is the issue but the lack of evidence in proportion to the strength of their beliefs. And in place of evidence their is paranoia. The problem is conspiracies by their nature are very hard to prove so your evidence for them will likely be weak