ICML · 2025 · Conference paper

LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning

Liu, Zihang, Tianyu Pang, Oleg Balabanov, Chaoqun Yang, Tianjin Huang, Lu Yin, Yang, Yaoqing, Shiwei Liu

PDF from arXiv.HTML · PDF · Open in a new tab ↗ · Close
Published in
International Conference on Machine Learning
Date
2025-06-01
Citations
13
arXiv
2506.00772
Cite
@inproceedings{zihang2025lift,
  title = {LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning},
  author = {Liu, Zihang and Tianyu Pang and Oleg Balabanov and Chaoqun Yang and Tianjin Huang and Lu Yin and Yang, Yaoqing and Shiwei Liu},
  year = {2025},
  booktitle = {International Conference on Machine Learning},
  eprint = {2506.00772},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2506.00772},
}