The theory isn’t that it’s caused by the brain alone, but rather it’s like the fandom limb pain sensation after an amputation. https://en.wikipedia.org/wiki/Phantom_limb

The difference is your auditory nerve doesn’t directly carry touch signals so you hear sounds instead of say an itch.