SYLIN

NeMo Switchyard

by NVIDIA · Framework · Text & code

Open-source model router; with Opus 4.8 and others it completed more tasks than Opus 4.8 alone at about one third the cost

AccessOpen codeLicenseApache 2.0

Evidence

  1. Aug 12
    Configured by one routes.toml with clients, named targets (weak, mid, strong) and routes; works with vLLM, Ollama, OpenRouter, LM Studio; API keys stay in env vars
  2. Aug 12
    NVIDIA charts show no single model wins every category, so routing by task is the pitch
  3. Aug 11
    NVIDIA shipped NeMo Switchyard alongside Lightning: agents talk to it and it routes each request to a model

Alternatives