You don’t have to install docker desktop. The cli can be installed via homebrew. (Co)Lima, podman, or others, can be used to create a VM running the docker engine.

It’s just that Docker Desktop makes it easy and also provides other integrations like file system sharing etc.