Tag: optimization
All the articles with the tag "optimization".
-
Muon Optimizer: From Conception to Modern Adaptations
Introduced in October 2024, Muon is a geometry-aware optimizer treating weight matrices as structured objects rather than flat vectors. In this article we study the evolution of Muon through recent advancements.