ICML · 2025 · Conference paper

LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning

Zihang Liu, Tianyu Pang, Oleg Balabanov, C. Yang, Tianjin Huang, Lu Yin, Yaoqing Yang, Shiwei Liu

Published in: International Conference on Machine Learning
Date: 2025-06-01
Citations: 13
arXiv: 2506.00772 ↗

Cite

@inproceedings{liu2025lift,
  title = {LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning},
  author = {Zihang Liu and Tianyu Pang and Oleg Balabanov and C. Yang and Tianjin Huang and Lu Yin and Yaoqing Yang and Shiwei Liu},
  year = {2025},
  booktitle = {International Conference on Machine Learning},
  eprint = {2506.00772},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2506.00772},
}