Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

24 papers of 11,817Sort Recent · Most cited
  1. 2021
    Same State, Different Task: Continual Reinforcement Learning without InterferenceSamuel Kessler, Jack Parker-Holder, Philip Ball … Stephen RobertsAAAI · University of Oxford
    PDF ↗
  2. 2021
    From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model CompressionRunxin Xu, Fuli Luo, Chengyu Wang … Fei HuangAAAI · Peking University · Alibaba Group (United States)
    PDF ↗
  3. 2021
    Static-Dynamic Co-Teaching for Class-Incremental 3D Object DetectionNa Zhao, Gim Hee LeeAAAI · National University of Singapore
    PDF ↗
  4. 2021
    Gradient-based Novelty Detection Boosted by Self-supervised Binary ClassificationJingbo Sun, Li Yang, Jiaxin Zhang … Yu CaoAAAI · Arizona State University · Oak Ridge National Laboratory · +1
    PDF ↗
  5. 2021
    Lifelong Generative Modelling Using Dynamic Expansion Graph ModelFei Ye, Adrian G. BorşAAAI · University of York
    PDF ↗
  6. 2021
    Lifelong Hyper-Policy Optimization with Multiple Importance Sampling RegularizationPierre Liotet, Francesco Vidaich, Alberto Maria Metelli, Marcello RestelliAAAI · Politecnico di Milano · University of Padua
    PDF ↗
  7. 2021
    Reducing Catastrophic Forgetting in Self Organizing Maps with Internally-Induced Generative ReplayHitesh Vaidya, Travis Desell, Alexander G. OrorbiaAAAI · Rochester Institute of Technology
    PDF ↗
  8. 2021
    Learning to Transfer with von Neumann Conditional DivergenceAmmar Shaker, Shujian Yu, Daniel Oñoro-RubioAAAI · Sharp Laboratories of Europe (United Kingdom) · Centre for Arctic Gas Hydrate, Environment and Climate · +2
    PDF ↗
  9. 2021
    Few-Shot Class-Incremental Learning via Relation Knowledge DistillationSonglin Dong, Xiaopeng Hong, Xiaoyu Tao … Yihong GongAAAI · Xi'an Jiaotong University
  10. 2021
    Overcoming Catastrophic Forgetting in Graph Neural Networks with Experience ReplayFan Zhou, Chengtai CaoAAAI · University of Electronic Science and Technology of China
  11. 2021
    Few-Shot Lifelong LearningPratik Mazumder, Pravendra Singh, Piyush RaiAAAI · Indian Institute of Technology Kanpur
    PDF ↗
  12. 2021
    Continual Learning for Named Entity RecognitionNatawut Monaikul, Giuseppe Castellucci, Simone Filice, Oleg RokhlenkoAAAI · University of Illinois Chicago · Amazon (Germany)
  13. 2021
    Curriculum-Meta Learning for Order-Robust Continual Relation ExtractionTongtong Wu, Xuekai Li, Yuan-Fang Li … Guoqiang XuAAAI · Southeast University · Monash University · +1
    PDF ↗
  14. 2021
    Continual Learning by Using Information of Each Class HolisticallyWenpeng Hu, Qi Qin, Mengyu Wang … Bing LiuAAAI · Peking University
  15. 2021
    Lifelong and Continual Learning Dialogue Systems: Learning during ConversationBing Liu, Sahisnu MazumderAAAI · University of Illinois Chicago
  16. 2021
    Class-Incremental Instance Segmentation via Multi-Teacher NetworksYanan Gu, Cheng Deng, Kun WeiAAAI · Xidian University
  17. 2021PDF ↗
  18. 2021
    A Continual Learning Framework for Uncertainty-Aware Interactive Image SegmentationErvine Zheng, Qi Yu, Rui Li … Anne R. HaakeAAAI · Rochester Institute of Technology
  19. 2021
    Asynchronous Teacher Guided Bit-wise Hard Mining for Online HashingSheng Jin, Qin Zhou, Hongxun Yao … Xian‐Sheng HuaAAAI · Harbin Institute of Technology · Alibaba Group (United States)
  20. 2021
    DeepCollaboration: Collaborative Generative and Discriminative Models for Class Incremental LearningBo Cui, Guyue Hu, Shan YuAAAI · University of Chinese Academy of Sciences · Center for Excellence in Brain Science and Intelligence Technology · +1
  21. 2021
  22. 2021
    Learning to Continually Learn Rapidly from Few and Noisy DataN. Kuo, Mehrtash Harandi, Nicolas Fourrier … H. SuominenAAAI
    PDF ↗
  23. 2021PDF ↗
  24. 2021
    Adversarial Shapley Value Experience Replay for Task-Free Continual LearningDongsub Shim, Zheda Mai, Jihwan Jeong … Jongseong JangAAAI · University of Toronto
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.