> unless you are directly mmapping and munmapping (or DONTNEEDing or similar) each allocation

You don't free up the memory you're not using? Sounds like you're doing it wrong then.

> I bet a really good AVX-512 transcoder with output size checking could be almost as fast as the OP.

Submit your pull request and we can evaluate your bet.