Ideally you should be able to produce a unique hash each time you vote, derived from your master key. The server doesn't need to know your private key. This is how crypto works now, generating unique and theoretically unlinkable wallet addresses from a secret key.