I'd probably be more sunk. When I was first learning and playing around with PGP, I published a key. Later, I changed the key for some reason or other but no longer had a way to revoke the old one. I'm pretty any of them out there are expired by now but for a few years it absolutely was possible to send me unreadable mail.
I think they are only using the “email address verified keys” that these “new-style key servers” use, so you’d be able to at least revoke that binding as long as you can receive unencrypted emails to that address.