NeurIPS · 2025 · Journal article

Mitigating Forgetting in LLM Fine-Tuning via Low-Perplexity Token Learning

Chao-Chung Wu, Zhi Rui Tam, Chieh-Yen Lin, Hung-yi Lee, Yun-Nung Chen

Published in
Neural Information Processing Systems
Date
2025-01-24
Citations
17
arXiv
2501.14315
Cite
@article{wu2025mitigating,
  title = {Mitigating Forgetting in LLM Fine-Tuning via Low-Perplexity Token Learning},
  author = {Chao-Chung Wu and Zhi Rui Tam and Chieh-Yen Lin and Hung-yi Lee and Yun-Nung Chen},
  year = {2025},
  journal = {Neural Information Processing Systems},
  eprint = {2501.14315},
  archivePrefix = {arXiv},
  doi = {10.52202/085713-0064},
  url = {https://arxiv.org/abs/2501.14315},
}