Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

24 papers of 11,817Sort Recent · Most cited
  1. 2025
    SLAM: Towards Efficient Multilingual Reasoning via Selective Language AlignmentYuchun Fan, Yongyu Mu, Yi-Lin Wang … Jingbo ZhuCOLING
    PDF ↗
  2. 2025
    Multilingual Continual Learning using Attention DistillationSanjay Agrawal, Deepa Nayak, Vivek SembiumCOLING
  3. 2025
    Rethinking Long Context Generation from the Continual Learning PerspectiveZeyuan Yang, Fangzhou Xiong, Peng Li, Yang LiuCOLING
  4. 2024
    In-context Continual Learning Assisted by an External Continual LearnerS. Momeni, Sahisnu Mazumder, Zixuan Ke, Bing LiuCOLING
    PDF ↗
  5. 2024PDF ↗
  6. 2024PDF ↗
  7. 2024
    Is Parameter Collision Hindering Continual Learning in LLMs?Shuo Yang, Kun-Peng Ning, Yu-Yang Liu … Li YuanCOLING
    PDF ↗
  8. 2024PDF ↗
  9. 2022
    Improving Continual Relation Extraction through Prototypical Contrastive LearningChengwei Hu, Deqing Yang, Haoliang Jin … Yanghua XiaoCOLING
    PDF ↗
  10. 2022
    Few-shot Table-to-text Generation with Prefix-Controlled GeneratorYutao Luo, Menghua Lu, Gongshen Liu, Shilin WangCOLING
    PDF ↗
  11. 2022
    Ask Question First for Enhancing Lifelong Language LearningHan Wang, Ruiliu Fu, Xuejun Zhang … Qingwei ZhaoCOLING
    PDF ↗
  12. 2022PDF ↗
  13. 2022
    Dynamic Dialogue Policy for Continual Reinforcement LearningChristian Geishauser, Carel van Niekerk, Nurul Lubis … Milica GašićCOLING
    PDF ↗
  14. 2022PDF ↗
  15. 2022
  16. 2020
    Continual Lifelong Learning in Natural Language Processing: A SurveyMagdalena Biesialska, Katarzyna Biesialska, Marta R. Costa-jussàCOLING · Universitat Politècnica de Catalunya
    PDF ↗
  17. 2020
    A Two-phase Prototypical Network Model for Incremental Few-shot Relation ClassificationHaopeng Ren, Yi Cai, Xiaofeng Chen … Qing LiCOLING · Ministry of Natural Resources · South China University of Technology · +1
  18. 2020
    Distill and Replay for Continual Language LearningJingyuan Sun, Shaonan Wang, Jiajun Zhang, Chengqing ZongCOLING · Institute of Automation · University of Chinese Academy of Sciences · +2
  19. 2020PDF ↗
  20. 2020
  21. 2020
    Emergent Communication Pretraining for Few-Shot Machine TranslationYaoyiran Li, Edoardo Maria Ponti, Ivan Vulić, Anna KorhonenCOLING · Tallinn University of Technology · University of Cambridge · +1
    PDF ↗
  22. 2018
    A Practical Incremental Learning Framework For Sparse Entity ExtractionHussein S. Al-Olimat, Steven Gustafson, Jason Mackay … Amit ShethCOLING
    PDF ↗
  23. 1996
    MBT: A Memory-Based Part of Speech Tagger-GeneratorWalter Daelemans, Jakub Zavrel, Peter Berck, Steven GillisCOLING · University of Antwerp · Tilburg University
    PDF ↗
  24. 1988
    Language Learning as Problem SolvingMichael Zock, Gil Francopoulo, Abdellatif LarouiCOLING · Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.