NAACL · 2024 · Conference paper

SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture

Jiayi Han, Liang Du, Hongwei Du, Xiangguo Zhou, Yi-Wen Wu, Yuan-Fang Zhang, Weibo Zheng, Donghong Han

Published in
North American Chapter of the Association for Computational Linguistics
Date
2024-10-10
Citations
20
arXiv
2410.07739
Cite
@inproceedings{han2024slim,
  title = {SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture},
  author = {Jiayi Han and Liang Du and Hongwei Du and Xiangguo Zhou and Yi-Wen Wu and Yuan-Fang Zhang and Weibo Zheng and Donghong Han},
  year = {2024},
  booktitle = {North American Chapter of the Association for Computational Linguistics},
  eprint = {2410.07739},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2410.07739},
}