OLMo-core
by Allen Institute for AI · Framework · Text & code
Allen AI training framework for mixture-of-experts models; keeps experts on their GPUs; claimed 2.7x faster training
AccessOpen codeLicenseApache 2.0
by Allen Institute for AI · Framework · Text & code
Allen AI training framework for mixture-of-experts models; keeps experts on their GPUs; claimed 2.7x faster training