SYLIN

WebLLM

by MLC AI · Runtime · Text & code

In-browser LLM inference engine using WebGPU; public demo at chat.webllm.ai

AccessOpen codePricefreeRuns onWebLicenseApache 2.0

Evidence

  1. Sep 2
    Commenters say it is stale: not updated since Gemma 2, and one dropped it after years of use
  2. Sep 2
    A commenter recommends Transformers.js over WebLLM these days because WebLLM lacks recent model support

Alternatives