SYLIN

vLLM Semantic Router

by vLLM · Runtime · Text & code

Gives an agent harness one API for many models, selecting or combining local, private and cloud backends per call by policy

AccessOpen codePricefree; open sourceLicenseApache 2.0

Evidence

  1. Nov 13
    Dashboard connects multiple vLLM backends by base URL; providers include Ollama, OpenAI-compatible and Anthropic-style APIs