Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

25 papers of 11,817Sort Recent · Most cited
  1. 2023PDF ↗
  2. 2023PDF ↗
  3. 2023
    Continual Contrastive Spoken Language UnderstandingUmberto Cappellazzo, Enrico Fini, Muqiao Yang … Bhiksha RajACL
    PDF ↗
  4. 2023PDF ↗
  5. 2023
    Domain-Agnostic Neural Architecture for Class Incremental Continual Learning in Document Processing PlatformMateusz Wójcik, Witold Kościukiewicz, Mateusz Baran … Adam GonczarekACL
    PDF ↗
  6. 2023
    Exploring Continual Learning for Code Generation ModelsPrateek Yadav, Q. Sun, Hantian Ding … Bing XiangACL
    PDF ↗
  7. 2023PDF ↗
  8. 2023
    Class-Incremental Learning based on Label GenerationYijia Shao, Yiduo Guo, Dongyan Zhao, Bin LiuACL
    PDF ↗
  9. 2023PDF ↗
  10. 2023PDF ↗
  11. 2023PDF ↗
  12. 2023
    Overcoming Catastrophic Forgetting in Massively Multilingual Continual LearningGenta Indra Winata, Lingjue Xie, Karthik Radhakrishnan … Daniel Preotiuc-PietroACL
    PDF ↗
  13. 2023
    TADA: Efficient Task-Agnostic Domain Adaptation for TransformersChia-Chien Hung, Lukas Lange, Jannik StrötgenACL
    PDF ↗
  14. 2023
    Learning Non-linguistic Skills without Sacrificing Linguistic ProficiencyMandar Sharma, Nikhil Muralidhar, Naren RamakrishnanACL
    PDF ↗
  15. 2023PDF ↗
  16. 2023
    Domain Incremental Lifelong Learning in an Open WorldYinpei Dai, Hao Lang, Yinhe Zheng … Yongbin LiACL
    PDF ↗
  17. 2023PDF ↗
  18. 2023
    Rehearsal-free Continual Language Learning via Efficient Parameter IsolationZhicheng Wang, Yufang Liu, Tao Ji … Wenqi ZengACL
  19. 2023
  20. 2023
    Large-scale Lifelong Learning of In-context Instructions and How to Tackle ItJ. Mok, Jaeyoung Do, Sungjin Lee … Sungroh YoonACL
  21. 2023
  22. 2023
  23. 2023
  24. 2023
  25. 2023PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.