Ai2 Releases Olmo-core 3, Reporting 2.7 Times Faster Mixture-of-Experts Training
The Allen Institute for AI's open-source training framework targets trillion-parameter mixture-of-experts models and posts a throughput lead over Nvidia's Megatron-core in Ai2's own test.
TECHNOLOGY · AI · CYBERSECURITY · THE SYSTEMS SHAPING BUSINESS