vLLM Semantic Router
by vLLM · Runtime · Text & code
Gives an agent harness one API for many models, selecting or combining local, private and cloud backends per call by policy
Evidence
- Nov 13Dashboard connects multiple vLLM backends by base URL; providers include Ollama, OpenAI-compatible and Anthropic-style APIs