arXiv · 2026 · Preprint

Muon-OGD: Muon-based Spectral Orthogonal Gradient Projection for LLM Continual Learning

Binghang Lu, Zheyuan Deng, Runyu Zhang, Bing Hu, Yunhan Zhao, Yuan Tian, Changhong Mou, Guang Lin, Xiaomin Li

PDF from arXiv.HTML · PDF · Open in a new tab ↗ · Close
Date
2026-05-09
Citations
5
arXiv
2605.08949
Cite
@misc{lu2026muonogd,
  title = {Muon-OGD: Muon-based Spectral Orthogonal Gradient Projection for LLM Continual Learning},
  author = {Binghang Lu and Zheyuan Deng and Runyu Zhang and Bing Hu and Yunhan Zhao and Yuan Tian and Changhong Mou and Guang Lin and Xiaomin Li},
  year = {2026},
  eprint = {2605.08949},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2605.08949},
}