EMNLP · 2024 · Conference paper

SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models

Jinghan He, Haiyun Guo, Kuan Zhu, Zihan Zhao, Ming Tang, Jinqiao Wang

Published in
Conference on Empirical Methods in Natural Language Processing
Date
2024-11-09
Citations
14
arXiv
2411.06171
Cite
@inproceedings{he2024seekr,
  title = {SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models},
  author = {Jinghan He and Haiyun Guo and Kuan Zhu and Zihan Zhao and Ming Tang and Jinqiao Wang},
  year = {2024},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  eprint = {2411.06171},
  archivePrefix = {arXiv},
  doi = {10.18653/v1/2024.emnlp-main.190},
  url = {https://arxiv.org/abs/2411.06171},
}