ICML · 2025 · Conference paper

LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning

Zihang Liu, Tianyu Pang, Oleg Balabanov, C. Yang, Tianjin Huang, Lu Yin, Yaoqing Yang, Shiwei Liu

Rendered by arXiv from the LaTeX source. If anything looks wrong, switch to the PDF.HTML · PDF · Open in a new tab ↗ · Close
Published in
International Conference on Machine Learning
Date
2025-06-01
Citations
13
arXiv
2506.00772
Cite
@inproceedings{liu2025lift,
  title = {LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning},
  author = {Zihang Liu and Tianyu Pang and Oleg Balabanov and C. Yang and Tianjin Huang and Lu Yin and Yaoqing Yang and Shiwei Liu},
  year = {2025},
  booktitle = {International Conference on Machine Learning},
  eprint = {2506.00772},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2506.00772},
}