NAACL · 2024 · Conference paper

RankAdaptor: Hierarchical Rank Allocation for Efficient Fine-Tuning Pruned LLMs via Performance Model

Changhai Zhou, Shijie Han, Li-Ning Yang, Yuhua Zhou, Xu Cheng, Yi-Bin Wang, Hong-Guang Li

Rendered by arXiv from the LaTeX source. If anything looks wrong, switch to the PDF.HTML · PDF · Open in a new tab ↗ · Close
Published in
North American Chapter of the Association for Computational Linguistics
Date
2024-06-22
Citations
12
arXiv
2406.15734
Cite
@inproceedings{zhou2024rankadaptor,
  title = {RankAdaptor: Hierarchical Rank Allocation for Efficient Fine-Tuning Pruned LLMs via Performance Model},
  author = {Changhai Zhou and Shijie Han and Li-Ning Yang and Yuhua Zhou and Xu Cheng and Yi-Bin Wang and Hong-Guang Li},
  year = {2024},
  booktitle = {North American Chapter of the Association for Computational Linguistics},
  eprint = {2406.15734},
  archivePrefix = {arXiv},
  doi = {10.18653/v1/2025.findings-naacl.321},
  url = {https://arxiv.org/abs/2406.15734},
}