Ai2 Unveils OlmoCore 3: A Groundbreaking Open Framework for MoE Training

The Allen Institute for AI has launched OlmoCore 3, an innovative open training framework for Mixture-of-Experts models. Released on October 1, 2026, it boasts improved throughput, capable of processing 52,000 tokens per second per GPU. The framework targets training efficiency, highlighting issues like token gerrymandering. With detailed documentation and pretraining scripts, it aims to enhance accessibility for researchers. OlmoCore 3 fosters open exploration in AI, supporting advancements in model training.