Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

126 papers of 8,653 · showing 101–126Sort Recent · Most cited
  1. 2023
    Soft Alignment Objectives for Robust Adaptation of Language GenerationMichal Štefánik, Marek Kadlčík, Petr SojkaACL · Masaryk University
    PDF ↗
  2. 2023
    Human Inspired Progressive Alignment and Comparative Learning for Grounded Word AcquisitionYuwei Bao, Barrett Lattimer, Joyce ChaiACL · University of Michigan
    PDF ↗
  3. 2023PDF ↗
  4. 2022
    On Continual Model Refinement in Out-of-Distribution Data StreamsBill Lin, Sida Wang, Xi Victoria Lin … Wen-tau YihACL
    PDF ↗
  5. 2022PDF ↗
  6. 2022
    ConTinTin: Continual Learning from Task InstructionsWenpeng Yin, Jia Li, Caiming XiongACL
    PDF ↗
  7. 2022
    Continual Prompt Tuning for Dialog State TrackingQi Zhu, Bing Li, Fei Mi … Minlie HuangACL
    PDF ↗
  8. 2022
    ELLE: Efficient Lifelong Pre-training for Emerging DataYujia Qin, Jiajie Zhang, Yankai Lin … Jie ZhouACL
    PDF ↗
  9. 2022PDF ↗
  10. 2022PDF ↗
  11. 2022PDF ↗
  12. 2022
    TimeLMs: Diachronic Language Models from TwitterDaniel Loureiro, Francesco Barbieri, Leonardo Neves … Jose Camacho-colladosACL · Universidade do Porto · Snap (United States) · +2
    PDF ↗
  13. 2022
    Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic SamplesYu Xia, Quan Wang, Yajuan Lyu … Dai DaiACL · Peking University · Baidu (China)
  14. 2022
    Few-Shot Class-Incremental Learning for Named Entity RecognitionRui Wang, Tong Yu, Handong Zhao … Ricardo HenaoACL · Duke University · Adobe Systems (United States)
  15. 2022
  16. 2021
    K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersRuize Wang, Duyu Tang, Nan Duan … Ming ZhouACL · Fudan University · Microsoft (United States) · +1
    PDF ↗
  17. 2020
    Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation ExtractionLi Cui, Deqing Yang, Jiaxin Yu … Yanghua XiaoACL · Fudan University
  18. 2020
    Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and MaskingBinzong Geng, Fajie Yuan, Qiancheng Xu … Min YangACL · University of Science and Technology of China · Chinese Academy of Sciences · +7
    PDF ↗
  19. 2020
    Learning to Solve NLP Tasks in an Incremental Number of LanguagesGiuseppe Castellucci, Simone Filice, Danilo Croce, Roberto BasiliACL · Amazon (United States) · Seattle University · +3
  20. 2020
    Rational LAMOL: A Rationale-based Lifelong Learning FrameworkKasidis Kanwatchara, Thanapapas Horsuwan, Piyawat Lertvittayakumjorn … Peerapon VateekulACL · Chulalongkorn University · Imperial College London
  21. 2020
    Continual Relation Learning via Episodic Memory Activation and ReconsolidationXu Han, Yi Dai, Tianyu Gao … Jie ZhouACL · Intelligent Systems Research (United States) · Intelligent Health (United Kingdom) · +3
  22. 2019
    Psycholinguistics Meets Continual Learning: Measuring Catastrophic Forgetting in Visual Question AnsweringClaudio Greco, Barbara Plank, Raquel Fernández, Raffaella BernardiACL · University of Trento · IT University of Copenhagen · +1
    PDF ↗
  23. 2019
    Continual and Multi-Task Architecture SearchRamakanth Pasunuru, Mohit BansalACL · University of North Carolina at Chapel Hill · University of North Carolina Health Care
    PDF ↗
  24. 2019
    Incremental Learning from Scratch for Task-Oriented Dialogue SystemsWeikang Wang, Jiajun Zhang, Qian Li … Zhifei LiACL · Shandong Institute of Automation · Institute of Automation · +3
    PDF ↗
  25. 2018
    Continuous Learning in a Hierarchical Multiscale Neural NetworkThomas Wolf, Julien Chaumond, Clément DelangueACL · Central European University · Bio Signal Group (United States)
    PDF ↗
  26. 2017
    Lifelong Learning CRF for Supervised Aspect ExtractionLei Shu, Hu Xu, Bing LiuACL · University of Illinois Chicago
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.