I've done that for years and it's a 'tax' for being allowed to use my actual headphones. Every single converter I've used will shit the bed after 6-12 months thanks to shitty cabling, and I've used both the official converters as well as third party ones. Eventually it becomes a fucking pain in the ass when it dies at an inconvenient time.

In comparison the headphones I've been using have lasted me for over 10+ years with no issue, and any decent high quality set of cans makes the 3.5mm cable easily replaceable.