Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Model routers are a "semantic" abstraction -- they analyze the contents of a prompt and automatically determine which provider to use. This proxy is (currently) much simpler: you pick the provider you want and we add a bunch of nice features like caching and low-latency on top.

We will likely work with or build some routing capabilities in the future!



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: