Simple Science

Cutting edge science explained simply

Cutting edge science explained simply

Steven Hoi

Machine Learning CompeteSMoE: Advancing Sparse Mixture of Experts Training

CompeteSMoE improves training efficiency and performance in Sparse Mixture of Experts models.

2025-09-11T14:48:24+00:00 ― 7 min read