Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 4051–4100Sort Recent · Most cited
  1. 2021
    A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap MatrixThang Doan, Mehdi Bennani, Bogdan Mazoure … Pierre AlquierAISTATS
    PDF ↗
  2. 2020
    The Effectiveness of Memory Replay in Large Scale Continual LearningYogesh Balaji, Mehrdad Farajtabar, Dong Yin … Ang LiarXiv
    PDF ↗
  3. 2021
    Remembering for the Right Reasons: Explanations Reduce Catastrophic ForgettingSayna Ebrahimi, S. Petryk, Akash Gokul … Trevor DarrellICLR
    PDF ↗
  4. 2020
    Meta-Consolidation for Continual LearningK J Joseph, Vineeth N BalasubramanianNeurIPS · Indian Institute of Technology Hyderabad
    PDF ↗
  5. 2020
    Continual Learning Of Predictive Models In Video Sequences Via Variational AutoencodersDamian Campo, Giulia Slavic, Mohamad Baydoun … Carlo S. RegazzoniInternational Conference on Information Photonics · University of Genoa
    PDF ↗
  6. 2020
    Faster ILOD: Incremental Learning for Object Detectors based on Faster RCNNCan Peng, Kun Zhao, Brian C. LovellPattern Recognition Letters · The University of Queensland
    PDF ↗
  7. 2020
    Metaplasticity in Multistate Memristor Synaptic NetworksFatima Tuz Zohora, Abdullah M. Zyarah, Nicholas Soures, Dhireesha KudithipudiInternational Symposium on Circuits and Systems · The University of Texas at San Antonio · Rochester Institute of Technology
    PDF ↗
  8. 2020
    Neurocoder: Learning General-Purpose Computation Using Stored Neural ProgramsHung Lê, Svetha VenkatesharXiv · Deakin University
    PDF ↗
  9. 2020
    Memory-Latency-Accuracy Trade-Offs for Continual Learning on a RISC-V Extreme-Edge NodeLeonardo Ravaglia, Manuele Rusci, Alessandro Capotondi … Luca BeniniIEEE Workshop on Signal Processing Systems · University of Bologna · University of Modena and Reggio Emilia · +1
    PDF ↗
  10. 2020
    Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the JobBing Liu, Sahisnu MazumderarXiv · University of Illinois Chicago
    PDF ↗
  11. 2020
    Class-Incremental Learning for Semantic Segmentation Re-Using Neither Old Data Nor Old LabelsMarvin Klingner, Andreas Bär, Philipp Donn, Tim FingscheidtIEEE 23rd International Conference on Intelligent Transpo… · Technische Universität Braunschweig
    PDF ↗
  12. 2020
    ADER: Adaptively Distilled Exemplar Replay Towards Continual Learning for Session-based RecommendationFei Mi, Xiaoyu Lin, Boi FaltingsRecSys · École Polytechnique Fédérale de Lausanne
    PDF ↗
  13. 2020
    Exploring Neuromodulation for Dynamic LearningAnurag Daram, Ángel Yanguas-Gil, Dhireesha KudithipudiFrontiers · The University of Texas at San Antonio · Argonne National Laboratory
    PDF ↗
  14. 2020
    Few-Shot Unsupervised Continual Learning through Meta-ExamplesAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniarXiv · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  15. 2020
    Measuring Information Transfer in Neural NetworksXiao Zhang, Xingjian Li, Dejing Dou, Ji WuarXiv · Tsinghua University · Baidu (China)
    PDF ↗
  16. 2020
    Meta-Learning with Sparse Experience Replay for Lifelong Language LearningNithin Holla, Pushkar Mishra, Helen Yannakoudakis, Ekaterina ShutovaarXiv · Meta (Israel) · King's College London · +1
    PDF ↗
  17. 2020
    Routing Networks with Co-training for Continual LearningMark Collier, Efi Kokiopoulou, Andréa Gesmundo, Jesse BerentarXiv · Google (United States)
    PDF ↗
  18. 2020
    Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language ModellingTsendsuren MunkhdalaiarXiv · Microsoft Research (United Kingdom)
    PDF ↗
  19. 2020
    Compression-aware Continual Learning using Singular Value DecompositionVarigonda Pavan Teja, Priyadarshini PandaarXiv · Yale University
    PDF ↗
  20. 2020
    Lifelong Object DetectionZhou Wang, Shiyu Chang, Norma Sosa … David CoxarXiv
    PDF ↗
  21. 2021
    Continual Learning Using Bayesian Neural NetworksHonglin Li, Payam Barnaghi, Shirin Enshaeifar, Frieder GanzTNNLS · University of Surrey · UK Dementia Research Institute · +1
    PDF ↗
  22. 2020
    Adversarial Shapley Value Experience Replay for Task-Free Continual LearningDongsub Shim, Zheda Mai, Jihwan Jeong … Jongseong JangAAAI · University of Toronto
    PDF ↗
  23. 2020PDF ↗
  24. 2020
    Brain-inspired replay for continual learning with artificial neural networksGido M. van de Ven, Hava T. Siegelmann, Andreas S. ToliasNature Communications · Baylor College of Medicine · University of Cambridge · +3
    PDF ↗
  25. 2020
    Emergence of Stable Synaptic Clusters on Dendrites Through Synaptic RewiringThomas Limbacher, Robert LegensteinFrontiers · Graz University of Technology
    PDF ↗
  26. 2021
    Incremental Concept Learning via Online Generative Memory RecallHuaiyu Li, Weiming Dong, Bao-Gang HuTNNLS · Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence · +2
    PDF ↗
  27. 2020
    Meta Continual Learning via Dynamic ProgrammingKrishnan, R., Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  28. 2020
    Continual Learning for Affective Robotics: Why, What and How?Nikhil Churamani, Sinan Kalkan, Hatice GüneşIEEE International Conference on Robot and Human Interact… · University of Cambridge · Middle East Technical University
    PDF ↗
  29. 2020
    Lifelong NavigationBo Liu, Xuesu Xiao, Peter StonearXiv · The University of Texas at Austin
    PDF ↗
  30. 2020
    La-MAML: Look-ahead Meta Learning for Continual LearningGunshi Gupta, Karmesh Yadav, Liam PaullNeurIPS · Carnegie Mellon University · Université de Montréal
    PDF ↗
  31. 2020PDF ↗
  32. 2020
    Boosting Deep Open World Recognition by ClusteringDario Fontanel, Fabio Cermelli, Massimiliano Mancini … Barbara CaputoRA-L · Politecnico di Torino · Italian Institute of Technology · +4
    PDF ↗
  33. 2020
    Multilayer Neuromodulated Architectures for Memory-Constrained Online Continual LearningSandeep Madireddy, Ángel Yanguas-Gil, Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  34. 2021
    Lifelong Learning of Compositional StructuresJorge A. Mendez, Eric EatonICLR · California University of Pennsylvania · University of Pennsylvania
    PDF ↗
  35. 2021
    Anatomy of Catastrophic Forgetting: Hidden Representations and Task SemanticsVinay Ramasesh, Ethan Dyer, Maithra RaghuICLR · Google (United States) · Cornell University
    PDF ↗
  36. 2020
    Lifelong Policy Gradient Learning of Factored Policies for Faster Training Without ForgettingJorge A. Mendez, Boyu Wang, Eric EatonNeurIPS · California University of Pennsylvania · University of Pennsylvania · +1
    PDF ↗
  37. 2020
    Lifelong Learning using Eigentasks: Task Separation, Skill Acquisition, and Selective TransferAswin Raghavan, Jesse Hostetler, Indranil Sur … Ajay DivakaranarXiv · SRI International
    PDF ↗
  38. 2020
    RATT: Recurrent Attention to Transient Tasks for Continual Image CaptioningRiccardo Del Chiaro, Bartłomiej Twardowski, Andrew D. Bagdanov, Joost van de WeijerNeurIPS
    PDF ↗
  39. 2020
    Disentanglement of Color and Shape Representations for Continual LearningDavid Berga, Marc Masana, Joost van de WeijerarXiv
    PDF ↗
  40. 2020
    Batch-level Experience Replay with Review for Continual LearningZheda Mai, Hyunwoo Kim, Jihwan Jeong, Scott SannerarXiv · University of Toronto
    PDF ↗
  41. 2021
    Graph-Based Continual LearningBinh Tang, David S. MattesonICLR · Cornell University
    PDF ↗
  42. 2021
    Wandering within a World: Online Contextualized Few-Shot LearningMengye Ren, Michael L. Iuzzolino, Michael C. Mozer, Richard S. ZemelICLR · University of Toronto · University of Colorado Boulder · +1
    PDF ↗
  43. 2020PDF ↗
  44. 2020
    Towards a practical measure of interference for reinforcement learningVincent Liu, Adam White, Hengshuai Yao, Martha WhitearXiv
    PDF ↗
  45. 2020
    Meta-Learning through Hebbian Plasticity in Random NetworksElias Najarro, Sebastian RisiNeurIPS · IT University of Copenhagen
    PDF ↗
  46. 2020PDF ↗
  47. 2020
    Pseudo-Rehearsal for Continual Learning with Normalizing FlowsJary Pomponi, Simone Scardapane, Aurelio UnciniarXiv · Sapienza University of Rome
    PDF ↗
  48. 2020
    On Class Orderings for Incremental LearningMarc Masana, Bartłomiej Twardowski, Joost van de WeijerarXiv
    PDF ↗
  49. 2020
    Eliminating Catastrophic Interference with Biased CompetitionAmelia Elizabeth Pollard, Jonathan ShapiroarXiv
    PDF ↗
  50. 2020
    Lifelong Zero-Shot LearningKun Wei, Cheng Deng, Xu YangIJCAI · Xidian University
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.