Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

301 papers of 8,653 · showing 101–150Sort Recent · Most cited
  1. 2020
    Towards a practical measure of interference for reinforcement learningVincent Liu, Adam White, Hengshuai Yao, Martha WhitearXiv
    PDF ↗
  2. 2020
    Meta-Learning through Hebbian Plasticity in Random NetworksElias Najarro, Sebastian RisiNeurIPS · IT University of Copenhagen
    PDF ↗
  3. 2020
    On Class Orderings for Incremental LearningMarc Masana, Bartłomiej Twardowski, Joost van de WeijerarXiv
    PDF ↗
  4. 2020
    Eliminating Catastrophic Interference with Biased CompetitionAmelia Elizabeth Pollard, Jonathan ShapiroarXiv
    PDF ↗
  5. 2020
    Catastrophic forgetting and mode collapse in GANsHoang Thanh-Tung, Truyen TranIJCNN · Deakin University · Allen Institute for Artificial Intelligence
  6. 2020
    Lifelong Zero-Shot LearningKun Wei, Cheng Deng, Xu YangIJCAI · Xidian University
  7. 2020
    Forget Me Not: Reducing Catastrophic Forgetting for Domain Adaptation in Reading ComprehensionYing Xu, Xu Zhong, Antonio Jimeno Yepes, Jey Han LauIJCNN · IBM Research - Australia · The University of Melbourne
    PDF ↗
  8. 2020
    Continual Learning with Gated Incremental Memories for sequential data processingAndrea Cossu, Antonio Carta, Davide BacciuIEEE International Joint Conference on Neural Network · University of Pisa
    PDF ↗
  9. 2020
    Memory Augmented Neural Model for Incremental Session-based RecommendationFei Mi, Boi FaltingsIJCAI · École Polytechnique Fédérale de Lausanne
    PDF ↗
  10. 2020
    Enabling Continual Learning with Differentiable Hebbian PlasticityVithursan Thangarasa, Thomas Miconi, Graham W. TaylorIEEE International Joint Conference on Neural Network · Vector Institute · University of Guelph · +1
    PDF ↗
  11. 2020
    OvA-INN: Continual Learning with Invertible Neural NetworksGuillaume Hocquet, Olivier Bichler, Damien QuerliozIJCNN · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +2
    PDF ↗
  12. 2020
    Online Knowledge Acquisition with the Selective Inherited ModelXiaocong Du, Shreyas Kolala Venkataramanaiah, Zheng Li … Yu CaoIJCNN · Arizona State University · Oak Ridge National Laboratory
  13. 2020
    Author response: Can sleep protect memories from catastrophic forgetting?Oscar C. González, Yury Sokolov, Giri P. Krishnan … Maxim BazhenovPreprint · University of California San Diego
  14. 2020
    Incremental Learning of Multi-Domain Image-to-Image TranslationsDaniel Stanley Tan, Yong-Xiang Lin, Kai‐Lung HuaIEEE TCSVT · National Taiwan University of Science and Technology
  15. 2020
    Supermasks in SuperpositionMitchell Wortsman, Vivek Ramanujan, Rosanne Liu … Ali FarhadiNeurIPS
    PDF ↗
  16. 2020
    Storing Encoded Episodes as Concepts for Continual LearningAli Ayub, Alan R. WagnerarXiv · Pennsylvania State University
    PDF ↗
  17. 2020
    Bookworm continual learning: beyond zero-shot learning and continual learningKai Wang, Luis Herranz, Anjan Dutta, Joost van de WeijerarXiv · Universitat Autònoma de Barcelona
    PDF ↗
  18. 2020PDF ↗
  19. 2020
  20. 2020
    Continual Learning in Recurrent Neural Networks with HypernetworksBenjamin Ehret, Christian Henning, Maria R. Cervera … Benjamin F. GrewearXiv · ETH Zurich
    PDF ↗
  21. 2020
    Automatic Recall Machines: Internal Replay, Continual Learning and the BrainXu Ji, João F. Henriques, Tinne Tuytelaars, Andrea VedaldiarXiv
    PDF ↗
  22. 2020
    Generalisation Guarantees for Continual Learning with Orthogonal Gradient DescentMehdi Bennani, Thang Doan, Masashi SugiyamaarXiv · École Nationale Supérieure des Mines de Paris · McGill University · +1
    PDF ↗
  23. 2020
    Neural Topic Modeling with Continual Lifelong LearningPankaj Gupta, Yatin Chaudhary, Thomas A. Runkler, Schütze, HinrichICML · Siemens (Germany) · Technical University of Munich · +2
    PDF ↗
  24. 2020
    Task-Agnostic Online Reinforcement Learning with an Infinite Mixture of Gaussian ProcessesMengdi Xu, Wenhao Ding, Jiacheng Zhu … Ding ZhaoNeurIPS · Carnegie Mellon University · Tsinghua University · +1
    PDF ↗
  25. 2020
    SOLA: Continual Learning with Second-Order Loss ApproximationDong Yin, Mehrdad Farajtabar, Ang Li … A. MottarXiv
    PDF ↗
  26. 2020PDF ↗
  27. 2020
    Learning to Learn with Feedback and Local PlasticityJack Lindsey, Ashok Litwin-KumarNeurIPS · Columbia University
    PDF ↗
  28. 2020
    An Improved Dual-Channel Network to Eliminate Catastrophic ForgettingDongbo Liu, Zhenan He, Dongdong Chen, Jiancheng LvIEEE Transactions · Sichuan University · State Key Laboratory of Hydraulics and Mountain River Engineering · +1
  29. 2020
    Real-world Cross-modal Retrieval via Sequential LearningGe Song, Xiaoyang TanIEEE Trans. Multimedia · Ministry of Industry and Information Technology · Nanjing University of Aeronautics and Astronautics
  30. 2020
    GAN Memory with No ForgettingYulai Cong, Miaoyun Zhao, Jianqiao Li … Lawrence CarinNeurIPS · Duke University
    PDF ↗
  31. 2020
    Understanding the Role of Training Regimes in Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu, Hassan GhasemzadehNeurIPS
    PDF ↗
  32. 2020
    Learning Causal Models OnlineKhurram Javed, Martha White, Yoshua BengioarXiv
    PDF ↗
  33. 2020
    BI-MAML: Balanced Incremental Approach for Meta LearningYang Zheng, Jinlin Xiang, Kun Su, Eli ShlizermanarXiv
    PDF ↗
  34. 2020
    Collaborative and continual learning for classification tasks in a society of devicesFernando E. Casado, Dylan Lema, Roberto Iglesias … Senén BarroarXiv
    PDF ↗
  35. 2020
    Move-to-Data: A new Continual Learning approach with Deep CNNs, Application for image-class recognitionMiltiadis Poursanidis, Jenny Benois‐Pineau, Akka Zemmari … Aymar de RugyarXiv · Laboratoire Bordelais de Recherche en Informatique · Institut de Neurosciences Cognitives et Intégratives d’Aquitaine
    PDF ↗
  36. 2020
    Understanding Regularisation Methods for Continual LearningFrederik BenzingarXiv · École Polytechnique Fédérale de Lausanne
    PDF ↗
  37. 2020
    Gaussian Gated Linear NetworksDavid Budden, Adam Marblestone, Eren Sezener … Joel VenessNeurIPS · Google (United States)
    PDF ↗
  38. 2020
    Optimal Continual Learning has Perfect Memory and is NP-hardJeremias Knoblauch, Hisham Husain, Tom DietheICML · University of Warwick · The Alan Turing Institute · +2
    PDF ↗
  39. 2020
    Coresets via Bilevel Optimization for Continual Learning and StreamingZalán Borsos, Mojmír Mutný, Andreas KrauseNeurIPS · ETH Zurich
    PDF ↗
  40. 2020
    Encoding primitives generation policy learning for robotic arm to overcome catastrophic forgetting in sequential multi-tasks learningFangzhou Xiong, Zhiyong Liu, Kaizhu Huang … Amir HussainNeural Networks · Shandong Institute of Automation · Institute of Automation · +7
  41. 2020
    Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversionHongxu Yin, Pavlo Molchanov, Jose M. Álvarez … Jan KautzCVPR · Princeton University · University of Illinois Urbana-Champaign
    PDF ↗
  42. 2020
    Maintaining Discrimination and Fairness in Class Incremental LearningBowen Zhao, Xi Xiao, Guojun Gan … Shu‐Tao XiaCVPR · Peng Cheng Laboratory · Tsinghua University
    PDF ↗
  43. 2020
    Few-Shot Class-Incremental LearningXiaoyu Tao, Xiaopeng Hong, Xinyuan Chang … Yihong GongCVPR · Xi'an Jiaotong University · Peng Cheng Laboratory
    PDF ↗
  44. 2020
    Semantic Drift Compensation for Class-Incremental LearningLu Yu, Bartłomiej Twardowski, Xialei Liu … Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · Northwestern Polytechnical University · +1
    PDF ↗
  45. 2020
    Mnemonics Training: Multi-Class Incremental Learning Without ForgettingYaoyao Liu, Yuting Su, An-An Liu … Qianru SunCVPR · Tianjin University · Max Planck Institute for Informatics · +1
    PDF ↗
  46. 2020
    Modeling the Background for Incremental Learning in Semantic SegmentationFabio Cermelli, Massimiliano Mancini, Samuel Rota Bulò … Barbara CaputoCVPR · Politecnico di Torino · Italian Institute of Technology · +3
    PDF ↗
  47. 2020
    Incremental Few-Shot Object DetectionJuan-Manuel Pérez-Rúa, Xiatian Zhu, Timothy M. Hospedales, Tao XiangCVPR · Samsung (United Kingdom) · University of Edinburgh · +1
    PDF ↗
  48. 2020
    Conditional Channel Gated Networks for Task-Aware Continual LearningDavide Abati, Jakub M. Tomczak, Tijmen Blankevoort … Babak Ehteshami BejnordiCVPR · University of Modena and Reggio Emilia
    PDF ↗
  49. 2020
    Generative Feature Replay For Class-Incremental LearningXialei Liu, Chenshen Wu, Mikel Menta … Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · University of Florence · +1
    PDF ↗
  50. 2020
    Incremental Learning in Online ScenarioJiangpeng He, Runyu Mao, Zeman Shao, Fengqing ZhuCVPR · Purdue University West Lafayette
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.