MiniCPM
by OpenBMB · Model · Language & code models
2B dense model that beats Qwen3.5-4B and similar small models on average; training data released
AccessOpen weightsNeeds~5 GB; smallest build ~4 GBDownload5 GBLicenseapache-2.0
Evidence
- Sep 13Claimed state of the art among similar-size small models
- Sep 8MiniCPM5-2B released: dense 2B model from OpenBMB, second in the MiniCPM5 series, 131K context
- Sep 8Found and fixed a subtle Oracle partition bug via Hermes Agent tool calls, but reasoning was very long; reviewer suggests minimal reasoning
- Sep 8Q8 GGUF hallucinated a nonexistent column in an Oracle SQL debugging test that the full-precision model solved
- Sep 7Training: base, mid and post-training; specialist RL teachers (math, code, agentic, writing) merged by on-policy distillation, adding about 11 points on reasoning