ai-dynamo

dynamo

A Datacenter Scale Distributed Inference Serving Framework

Rust NOASSERTION AI / Machine Learning DevOps / Cloud / Infra CONTRIBUTING.md
Stars 8.5k
Forks 1.9k
Open issues 932
Last push

Issues stay on GitHub. Read the thread before starting work.

Topics

diffusiondisaggregated-servingkubernetesllm-inferenceomnirouting-enginerustsglangtensorrt-llmvllm