Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

93 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2025PDF ↗
  2. 2025PDF ↗
  3. 2025PDF ↗
  4. 2025PDF ↗
  5. 2025PDF ↗
  6. 2025PDF ↗
  7. 2025PDF ↗
  8. 2025PDF ↗
  9. 2025PDF ↗
  10. 2025
    Continual Learning of Large Language ModelsTongtong Wu, Thuy-Trang Vu, Linhao Luo, Gholamreza HaffariEMNLP
    PDF ↗
  11. 2025
    RECALL: REpresentation-aligned Catastrophic-forgetting ALLeviation via Hierarchical Model MergingBowen Wang, Haiyuan Wan, Liwen Shi … Sheng ZhangEMNLP · University Town of Shenzhen · Tsinghua–Berkeley Shenzhen Institute · +6
    PDF ↗
  12. 2025
    DACIP-RC: Domain Adaptive Continual Instruction Pre-Training via Reading Comprehension on Business ConversationsElena Khasanova, Harsh Saini, Md Tahmid Rahman Laskar … Shashi Bhushan TNEMNLP · DIAL (Germany)
    PDF ↗
  13. 2025
    MKT: A Multi-Stage Knowledge Transfer Framework to Mitigate Catastrophic Forgetting in Multi-Domain Chinese Spelling CorrectionPeng Xing, Yinghui Li, Shirong Ma … Ying ShenEMNLP · Tsinghua–Berkeley Shenzhen Institute · Beihang University · +2
    PDF ↗
  14. 2025
    Safeguard Fine-Tuned LLMs Through Pre- and Post-Tuning Model MergingHua Farn, Hsuan Su, Shachi H Kumar … Hung-yi LeeEMNLP
    PDF ↗
  15. 2025
    VersaTune: An Efficient Data Composition Framework for Training Multi-Capability LLMsKeer Lu, Keshi Zhao, Zhang, Zhuoran … Wentao ZhangEMNLP
    PDF ↗
  16. 2024
    Lifelong Event Detection via Optimal TransportViet Dao, Van-Cuong Pham, Quyen Tran … Thien Huu NguyenEMNLP
    PDF ↗
  17. 2024PDF ↗
  18. 2024
    Preserving Generalization of Language models in Few-shot Continual Relation ExtractionQuyen Tran, Nguyễn Xuân Thành, Nguyễn Hoàng Ánh … Thien Huu NguyenEMNLP
    PDF ↗
  19. 2024PDF ↗
  20. 2024
    Learning to Route for Dynamic Adapter Composition in Continual Learning with Language ModelsVladimir Araujo, Marie‐Francine Moens, Tinne TuytelaarsEMNLP
    PDF ↗
  21. 2024PDF ↗
  22. 2024
    Mitigating Catastrophic Forgetting in Language Transfer via Model MergingAnton Alexandrov, Veselin Raychev, Mark Niklas Müller … Kristina ToutanovaEMNLP
    PDF ↗
  23. 2024PDF ↗
  24. 2024
    Breaking Language Barriers: Cross-Lingual Continual Pre-Training at ScaleWenzhen Zheng, Wenbo Pan, Xu Xu … Ming ZhouEMNLP
    PDF ↗
  25. 2024PDF ↗
  26. 2024
    Unlocking Continual Learning Abilities in Language ModelsWenyu Du, Shuang Cheng, Tongxu Luo … Jie FuEMNLP
    PDF ↗
  27. 2024
    Self-training Large Language Models through Knowledge DetectionWei Jie Yeo, Teddy Ferdinan, Przemysław Kazienko … Erik CambriaEMNLP
    PDF ↗
  28. 2024
    Revisiting Catastrophic Forgetting in Large Language Model TuningHongyu Li, Liang Ding, Meng Fang, Dacheng TaoEMNLP
    PDF ↗
  29. 2024PDF ↗
  30. 2024PDF ↗
  31. 2024PDF ↗
  32. 2024
    Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing AgentXiaoyan Yu, Tongxu Luo, Yifan Wei … Liehuang ZhuEMNLP
    PDF ↗
  33. 2024
    Breaking the Curse of Multilinguality with Cross-lingual Expert Language ModelsTerra Blevins, Tomasz Limisiewicz, Suchin Gururangan … Luke ZettlemoyerEMNLP
    PDF ↗
  34. 2024
    SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language ModelsJinghan He, Haiyun Guo, Kuan Zhu … Jinqiao WangEMNLP · Beijing Academy of Artificial Intelligence · Institute of Automation · +1
    PDF ↗
  35. 2024
    TL-CL: Task And Language Incremental Continual LearningShrey Satapara, P. K. SrijithEMNLP · Indian Institute of Technology Hyderabad
    PDF ↗
  36. 2024PDF ↗
  37. 2024
    Gradient Localization Improves Lifelong Pretraining of Language ModelsJared Fernandez, Yonatan Bisk, Emma StrubellEMNLP · Carnegie Mellon University
    PDF ↗
  38. 2024
    ICL: Iterative Continual Learning for Multi-domain Neural Machine TranslationZhibo Man, Kaiyu Huang, Yujie Zhang … Jinan XuEMNLP · Beijing Jiaotong University
    PDF ↗
  39. 2023
    CITB: A Benchmark for Continual Instruction TuningZihan Zhang, Meng Fang, Ling Chen, Mohammad‐Reza Namazi‐RadEMNLP
    PDF ↗
  40. 2023
    Continual Named Entity Recognition without Catastrophic ForgettingDuzhen Zhang, Cong Wei, Jiahua Dong … Zhen FangEMNLP
    PDF ↗
  41. 2023
    Coordinated Replay Sample Selection for Continual Federated LearningJack Good, Jimit Majmudar, Christophe Dupuy … Rahul GuptaEMNLP
    PDF ↗
  42. 2023
    Orthogonal Subspace Learning for Language Model Continual LearningXinghuan Wang, Tianze Chen, Qiming Ge … Xuanjing HuangEMNLP
    PDF ↗
  43. 2023PDF ↗
  44. 2023
    Sub-network Discovery and Soft-masking for Continual Learning of Mixed TasksZixuan Ke, Bing Liu, Wenhan Xiong … Haoran LiEMNLP
    PDF ↗
  45. 2023
    Rationale-Enhanced Language Models are Better Continual Relation LearnersWeimin Xiong, Yifan Song, Peiyi Wang, Sujian LiEMNLP
    PDF ↗
  46. 2023PDF ↗
  47. 2023
    Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data CurationDa Yin, Xiao Liu, Fan Yin … Kai-Wei ChangEMNLP
    PDF ↗
  48. 2023
    Continual Dialogue State Tracking via Example-Guided Question AnsweringHyundong Cho, Andrea Madotto, Zhaojiang Lin … Chinnadhurai SankarEMNLP
    PDF ↗
  49. 2023PDF ↗
  50. 2023PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.