Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Lessons learned – 5x throughput on data pipelines with adaptive batching (cocoindex.io)
3 points by georgehe9 3 months ago | hide | past | favorite | 1 comment


Hi I’m George, I’d love to share lessons we made optimizing data pipelines with AI / embedding calls for our users, which increased the pipeline throughput 5x. We did adaptive batching - discussed in detail how we did it. Developers still simply process data row-by-row, under the hood we queue requests and batch at the right moments (batching is effectively columnar), so no manual plumbing. Would love your thought.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: