Just running VMWare Fusion Pro on my M1 MBP. Choose connect to server -> enter IP address /login/password for your ESXi host. Launch virtual machine. Then you can simply tell Fusion to connect any USB devices to the remote VM, the same way you would if it were a local VM.