Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 4101–4150Sort Recent · Most cited
  1. 2020
    Forget Me Not: Reducing Catastrophic Forgetting for Domain Adaptation in Reading ComprehensionYing Xu, Xu Zhong, Antonio Jimeno Yepes, Jey Han LauIJCNN · IBM Research - Australia · The University of Melbourne
    PDF ↗
  2. 2020
    Continual Learning with Gated Incremental Memories for sequential data processingAndrea Cossu, Antonio Carta, Davide BacciuIEEE International Joint Conference on Neural Network · University of Pisa
    PDF ↗
  3. 2020
    Memory Augmented Neural Model for Incremental Session-based RecommendationFei Mi, Boi FaltingsIJCAI · École Polytechnique Fédérale de Lausanne
    PDF ↗
  4. 2020PDF ↗
  5. 2020
    Enabling Continual Learning with Differentiable Hebbian PlasticityVithursan Thangarasa, Thomas Miconi, Graham W. TaylorIEEE International Joint Conference on Neural Network · Vector Institute · University of Guelph · +1
    PDF ↗
  6. 2020
    OvA-INN: Continual Learning with Invertible Neural NetworksGuillaume Hocquet, Olivier Bichler, Damien QuerliozIJCNN · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +2
    PDF ↗
  7. 2021
    IncDet: In Defense of Elastic Weight Consolidation for Incremental Object DetectionLiyang Liu, Zhanghui Kuang, Yimin Chen … Wayne ZhangTNNLS · University Town of Shenzhen · Tsinghua University · +2
    PDF ↗
  8. 2021PDF ↗
  9. 2020
    Supermasks in SuperpositionMitchell Wortsman, Vivek Ramanujan, Rosanne Liu … Ali FarhadiNeurIPS
    PDF ↗
  10. 2020
    Storing Encoded Episodes as Concepts for Continual LearningAli Ayub, Alan R. WagnerarXiv · Pennsylvania State University
    PDF ↗
  11. 2020
    Bookworm continual learning: beyond zero-shot learning and continual learningKai Wang, Luis Herranz, Anjan Dutta, Joost van de WeijerarXiv · Universitat Autònoma de Barcelona
    PDF ↗
  12. 2020PDF ↗
  13. 2020PDF ↗
  14. 2020
    Continual Learning in Recurrent Neural Networks with HypernetworksBenjamin Ehret, Christian Henning, Maria R. Cervera … Benjamin F. GrewearXiv · ETH Zurich
    PDF ↗
  15. 2020
    Automatic Recall Machines: Internal Replay, Continual Learning and the BrainXu Ji, João F. Henriques, Tinne Tuytelaars, Andrea VedaldiarXiv
    PDF ↗
  16. 2020
    Generalisation Guarantees for Continual Learning with Orthogonal Gradient DescentMehdi Bennani, Thang Doan, Masashi SugiyamaarXiv · École Nationale Supérieure des Mines de Paris · McGill University · +1
    PDF ↗
  17. 2020
    Neural Topic Modeling with Continual Lifelong LearningPankaj Gupta, Yatin Chaudhary, Thomas A. Runkler, Schütze, HinrichICML · Siemens (Germany) · Technical University of Munich · +2
    PDF ↗
  18. 2020
    Task-Agnostic Online Reinforcement Learning with an Infinite Mixture of Gaussian ProcessesMengdi Xu, Wenhao Ding, Jiacheng Zhu … Ding ZhaoNeurIPS · Carnegie Mellon University · Tsinghua University · +1
    PDF ↗
  19. 2020
    SOLA: Continual Learning with Second-Order Loss ApproximationDong Yin, Mehrdad Farajtabar, Ang Li … A. MottarXiv
    PDF ↗
  20. 2020PDF ↗
  21. 2020
    Learning to Learn with Feedback and Local PlasticityJack Lindsey, Ashok Litwin-KumarNeurIPS · Columbia University
    PDF ↗
  22. 2020
    GAN Memory with No ForgettingYulai Cong, Miaoyun Zhao, Jianqiao Li … Lawrence CarinNeurIPS · Duke University
    PDF ↗
  23. 2020
    Understanding the Role of Training Regimes in Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu, Hassan GhasemzadehNeurIPS
    PDF ↗
  24. 2021
    CPR: Classifier-Projection Regularization for Continual LearningSungmin Cha, Hsiang Hsu, Taebaek Hwang … Taesup MoonICLR
    PDF ↗
  25. 2020
    Learning Causal Models OnlineKhurram Javed, Martha White, Yoshua BengioarXiv
    PDF ↗
  26. 2020
    BI-MAML: Balanced Incremental Approach for Meta LearningYang Zheng, Jinlin Xiang, Kun Su, Eli ShlizermanarXiv
    PDF ↗
  27. 2020
    Collaborative and continual learning for classification tasks in a society of devicesFernando E. Casado, Dylan Lema, Roberto Iglesias … Senén BarroarXiv
    PDF ↗
  28. 2020
    Move-to-Data: A new Continual Learning approach with Deep CNNs, Application for image-class recognitionMiltiadis Poursanidis, Jenny Benois‐Pineau, Akka Zemmari … Aymar de RugyarXiv · Laboratoire Bordelais de Recherche en Informatique · Institut de Neurosciences Cognitives et Intégratives d’Aquitaine
    PDF ↗
  29. 2020
    Understanding Regularisation Methods for Continual LearningFrederik BenzingarXiv · École Polytechnique Fédérale de Lausanne
    PDF ↗
  30. 2020
    Self-Supervised Learning Aided Class-Incremental Lifelong LearningSong Zhang, Gehui Shen, Huang, Jinsong, Deng, Zhi-HongarXiv · Peking University
    PDF ↗
  31. 2020
    Gaussian Gated Linear NetworksDavid Budden, Adam Marblestone, Eren Sezener … Joel VenessNeurIPS · Google (United States)
    PDF ↗
  32. 2020
    Optimal Continual Learning has Perfect Memory and is NP-hardJeremias Knoblauch, Hisham Husain, Tom DietheICML · University of Warwick · The Alan Turing Institute · +2
    PDF ↗
  33. 2021
    Variational Auto-Regressive Gaussian Processes for Continual LearningSanyam Kapoor, Theofanis Karaletsos, Thang D. BuiICML · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +3
    PDF ↗
  34. 2020
    Coresets via Bilevel Optimization for Continual Learning and StreamingZalán Borsos, Mojmír Mutný, Andreas KrauseNeurIPS · ETH Zurich
    PDF ↗
  35. 2020
    Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversionHongxu Yin, Pavlo Molchanov, Jose M. Álvarez … Jan KautzCVPR · Princeton University · University of Illinois Urbana-Champaign
    PDF ↗
  36. 2020
    Maintaining Discrimination and Fairness in Class Incremental LearningBowen Zhao, Xi Xiao, Guojun Gan … Shu‐Tao XiaCVPR · Peng Cheng Laboratory · Tsinghua University
    PDF ↗
  37. 2020
    Few-Shot Class-Incremental LearningXiaoyu Tao, Xiaopeng Hong, Xinyuan Chang … Yihong GongCVPR · Xi'an Jiaotong University · Peng Cheng Laboratory
    PDF ↗
  38. 2020
    Semantic Drift Compensation for Class-Incremental LearningLu Yu, Bartłomiej Twardowski, Xialei Liu … Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · Northwestern Polytechnical University · +1
    PDF ↗
  39. 2020
    Mnemonics Training: Multi-Class Incremental Learning Without ForgettingYaoyao Liu, Yuting Su, An-An Liu … Qianru SunCVPR · Tianjin University · Max Planck Institute for Informatics · +1
    PDF ↗
  40. 2020
    Modeling the Background for Incremental Learning in Semantic SegmentationFabio Cermelli, Massimiliano Mancini, Samuel Rota Bulò … Barbara CaputoCVPR · Politecnico di Torino · Italian Institute of Technology · +3
    PDF ↗
  41. 2020
    Incremental Few-Shot Object DetectionJuan-Manuel Pérez-Rúa, Xiatian Zhu, Timothy M. Hospedales, Tao XiangCVPR · Samsung (United Kingdom) · University of Edinburgh · +1
    PDF ↗
  42. 2020
    Conditional Channel Gated Networks for Task-Aware Continual LearningDavide Abati, Jakub M. Tomczak, Tijmen Blankevoort … Babak Ehteshami BejnordiCVPR · University of Modena and Reggio Emilia
    PDF ↗
  43. 2020
    Generative Feature Replay For Class-Incremental LearningXialei Liu, Chenshen Wu, Mikel Menta … Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · University of Florence · +1
    PDF ↗
  44. 2020
    Incremental Learning in Online ScenarioJiangpeng He, Runyu Mao, Zeman Shao, Fengqing ZhuCVPR · Purdue University West Lafayette
    PDF ↗
  45. 2020
    Lifelong Machine Learning with Deep Streaming Linear Discriminant AnalysisTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology
    PDF ↗
  46. 2020
    iTAML: An Incremental Task-Agnostic Meta-learning ApproachJathushan Rajasegaran, Salman Khan, Munawar Hayat … Mubarak ShahCVPR · Inception Institute of Artificial Intelligence · Linköping University · +1
    PDF ↗
  47. 2020
    Continual Learning for Anomaly Detection in Surveillance VideosKeval Doshi, Yasin YılmazCVPR · University of South Florida
    PDF ↗
  48. 2020
    Learning to Segment the TailXinting Hu, Yi Jiang, Kaihua Tang … Hanwang ZhangCVPR · Nanyang Technological University · Alibaba Group (United States) · +1
    PDF ↗
  49. 2020
    Rehearsal-Free Continual Learning over Small Non-I.I.D. BatchesVincenzo Lomonaco, Davide Maltoni, Lorenzo PellegriniCVPR · University of Bologna
    PDF ↗
  50. 2020
    Continual Learning With Extended Kronecker-Factored Approximate CurvatureJanghyeon Lee, Hyeong Gwon Hong, Donggyu Joo, Junmo KimCVPR · Korea Advanced Institute of Science and Technology
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.