Ray doesn't offer anything if you use vLLM on top of Ray Serve though. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ipsum2 6 months ago \| parent \| context \| favorite \| on: Nvidia Dynamo: A Datacenter Scale Distributed Infe... Ray doesn't offer anything if you use vLLM on top of Ray Serve though.

dzr0001 6 months ago [–]

It does if you need pipeline parallelism across multiple nodes.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact