NeMo Switchyard
by NVIDIA · Framework · Text & code
Open-source model router; with Opus 4.8 and others it completed more tasks than Opus 4.8 alone at about one third the cost
AccessOpen codeLicenseApache 2.0
Evidence
- Aug 12Configured by one routes.toml with clients, named targets (weak, mid, strong) and routes; works with vLLM, Ollama, OpenRouter, LM Studio; API keys stay in env vars
- Aug 12NVIDIA charts show no single model wins every category, so routing by task is the pitch
- Aug 11NVIDIA shipped NeMo Switchyard alongside Lightning: agents talk to it and it routes each request to a model