Looks like they also have a newer 'NanoPI NEO3' version. It comes with USB-C for power, USB 3.0 (Type A) for data, and 1/2GB RAM options. $20-25 depending on the RAM choice.
You install the OS on a TF (Micro SD) card using your desktop computer and then put the card in the ZeroPi. After booting, you can connect through the serial port or ssh via Ethernet or WiFi, depending on what you have set up.
Insert the SD card into another machine, add a boot and filesystem partition, install OS onto it, mount the filesystem of the SD card, chroot to it, and install sshd.
1: https://www.friendlyarm.com/index.php?route=product/product&...