Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

29 papers of 11,817Sort Recent · Most cited
  1. 2024
    Safeguard Fine-Tuned LLMs Through Pre- and Post-Tuning Model MergingHua Farn, Hsuan Su, Shachi H. Kumar … Hung-yi LeeEMNLP
    PDF ↗
  2. 2024PDF ↗
  3. 2024PDF ↗
  4. 2024PDF ↗
  5. 2024
    Gradient Localization Improves Lifelong Pretraining of Language ModelsJared Fernandez, Yonatan Bisk, Emma StrubellEMNLP
    PDF ↗
  6. 2024
    Lifelong Event Detection via Optimal TransportViet-Hung Dao, Van-Cuong Pham, Quyen Tran … T. NguyenEMNLP
    PDF ↗
  7. 2024PDF ↗
  8. 2024PDF ↗
  9. 2024PDF ↗
  10. 2024
    Preserving Generalization of Language models in Few-shot Continual Relation ExtractionQ. Tran, Thanh Xuan Nguyen, Anh Hoang Nguyen … T. NguyenEMNLP
    PDF ↗
  11. 2024PDF ↗
  12. 2024PDF ↗
  13. 2024PDF ↗
  14. 2024
    Mitigating Catastrophic Forgetting in Language Transfer via Model MergingAnton Alexandrov, Veselin Raychev, Mark Niklas Müller … Kristina ToutanovaEMNLP
    PDF ↗
  15. 2024PDF ↗
  16. 2024
    Breaking Language Barriers: Cross-Lingual Continual Pre-Training at ScaleWen-Zheng Zheng, Wenbo Pan, Xun Xu … Ming ZhouEMNLP
    PDF ↗
  17. 2024PDF ↗
  18. 2024
    Unlocking Continual Learning Abilities in Language ModelsWenyu Du, Shuang Cheng, Tongxu Luo … Jie FuEMNLP
    PDF ↗
  19. 2024
    Self-training Large Language Models through Knowledge DetectionWei Jie Yeo, Teddy Ferdinan, Przemysław Kazienko … Erik CambriaEMNLP
    PDF ↗
  20. 2024
    Revisiting Catastrophic Forgetting in Large Language Model TuningHongyu Li, Liang Ding, Meng Fang, D. TaoEMNLP
    PDF ↗
  21. 2024PDF ↗
  22. 2024PDF ↗
  23. 2024
    Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt LearningQizhou Chen, Taolin Zhang, Dongyang Li … Xiaofeng HeEMNLP
    PDF ↗
  24. 2024
    Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing AgentXiaoyan Yu, Tongxu Luo, Yifan Wei … Liehuang ZhuEMNLP
    PDF ↗
  25. 2024PDF ↗
  26. 2024
    Breaking the Curse of Multilinguality with Cross-lingual Expert Language ModelsTerra Blevins, Tomasz Limisiewicz, Suchin Gururangan … Luke S. ZettlemoyerEMNLP
    PDF ↗
  27. 2024
    MLLM-Protector: Ensuring MLLM’s Safety without Hurting PerformanceRenjie Pi, Tianyang Han, Jianshu Zhang … Jipeng ZhangEMNLP
    PDF ↗
  28. 2024
  29. 2024
    ICL: Iterative Continual Learning for Multi-domain Neural Machine TranslationZhibo Man, Kaiyu Huang, Yu-Jie Zhang … Jinan XuEMNLP
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.