Disaggregated Serving: Dynamo, llm-d, and When Splitting Prefill from Decode Pays
Why production stacks run prefill and decode on separate GPUs, how NVIDIA Dynamo and llm-d move the KV cache between them, and when the split pays.
disaggregation
1 post