Because additional grams in orbit are equivalent to additional joules of energy released as weaponry, e.g. dropping rocks. I fear that our ability to use space to destroy ourselves will come before we can use it to launch a diaspora.
Doesn’t rock dropping as a weapon seem a bit redundant when we already have the ability to make lots of 20+ megaton fusion bombs? I guess non-proliferation is harder.