Yes, only criminals and police. And black market weapons are expensive, so they are also very hard to get for criminals. This works very well in many, many other countries.

As a particularly interesting example: Japan has almost no gun crime at all: https://www.bbc.com/news/magazine-38365729

> In 2014 there were just six gun deaths, compared to 33,599 in the US.