I followed this guide on how to install a self-signed certificate and setup the routing to my proxy server on an Apple TV: https://lucaslegname.github.io/mitmproxy/2020/04/10/mitmprox...

TL;DR it involves using Apple Configuration to make a custom mobileconfig profile to point to your proxy and then also installing the certificate with the same method.