Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

92 papers of 6,984 · showing 51–92Sort Recent · Most cited
  1. 2023
    Continual Learning with Invertible Generative ModelsJary Pomponi, Simone Scardapane, Aurelio UnciniNeural Networks · Sapienza University of Rome
    PDF ↗
  2. 2023
    Multi-granularity knowledge distillation and prototype consistency regularization for class-incremental learningYanyan Shi, Dianxi Shi, Dianxi Shi … Chunping QiuNeural Networks · National University of Defense Technology · National Defense University
  3. 2023
    Lifelong learning on evolving graphs under the constraints of imbalanced classes and new classesLukas Galke, Iacopo Vagliano, Benedikt Franke … Ansgar ScherpNeural Networks · Max Planck Institute for Psycholinguistics · Amsterdam University Medical Centers · +3
    PDF ↗
  4. 2023
    Growing dendrites enhance a neuron's computational power and memory capacityWilliam B. Levy, Robert A. BaxterNeural Networks · University of Virginia · Baxter (United States)
    PDF ↗
  5. 2023
    Imitating the oracle: Towards calibrated model for class incremental learningFei Zhu, Zhen Cheng, Xu-Yao Zhang, Cheng‐Lin LiuNeural Networks · Chinese Academy of Sciences · Shandong Institute of Automation · +3
  6. 2024
    A Survey on Few-Shot Class-Incremental LearningSongsong Tian, Lusi Li, Weijun Li … Prayag TiwariNeural Networks
    PDF ↗
  7. 2023
    Lifelong learning with Shared and Private Latent Representations learned through synaptic intelligenceYang Yang, Jie Huang, Dexiu HuNeural Networks · PLA Information Engineering University
  8. 2023
    Online continual learning with declarative memoryZhe Xiao, Zhekai Du, Ruijin Wang … Jingjing LiNeural Networks · China Electronics Technology Group Corporation · Hebei Science and Technology Department · +1
  9. 2023
    Emphasizing Unseen Words: New Vocabulary Acquisition for End-to-End Speech RecognitionLeyuan Qu, Cornelius Weber, Stefan WermterNeural Networks · Universität Hamburg · Zhejiang Lab · +2
    PDF ↗
  10. 2023
    Improving transparency and representational generalizability through parallel continual learningM Paknezhad, Hamsawardhini Rengarajan, Chenghao Yuan … Hwee Kuan LeeNeural Networks · Agency for Science, Technology and Research · Bioinformatics Institute · +2
  11. 2023
    SuperFormer: Continual learning superposition method for text classificationMarko Zeman, Jana Faganeli Pucer, Igor Kononenko, Zoran BosnićNeural Networks · University of Ljubljana
    PDF ↗
  12. 2023
    Leveraging joint incremental learning objective with data ensemble for class incremental learningPratik Mazumder, Mohammed Asad Karim, Indu Joshi, Pravendra SinghNeural Networks · Indian Institute of Technology Jodhpur · Carnegie Mellon University · +2
  13. 2020
    A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World LearningMartin Mundt, Yongwon Hong, Iuliia Pliushch, Visvanathan RameshNeural Networks · Goethe University Frankfurt · Technische Universität Darmstadt · +1
    PDF ↗
  14. 2023
    A Domain-Agnostic Approach for Characterization of Lifelong Learning SystemsMegan M. Baker, Alexander New, Mario Aguilar-Simon … Gautam K. VallabhaNeural Networks · Johns Hopkins University Applied Physics Laboratory · Teledyne Technologies (United States) · +13
    PDF ↗
  15. 2023
    Efficient Perturbation Inference and Expandable Network for continual learningFei Du, Yun Yang, Ziyuan Zhao, Zeng ZengNeural Networks · Yunnan University · Agency for Science, Technology and Research · +1
  16. 2023
    CLAD: A realistic Continual Learning benchmark for Autonomous DrivingEli Verwimp, Kuo Yang, Sarah Parisot … Tinne TuytelaarsNeural Networks
    PDF ↗
  17. 2022
    TaskDrop: A Competitive Baseline for Continual Learning of Sentiment ClassificationJian-Ping Mei, Yilun Zhen, Qianwei Zhou, Rui YanNeural Networks · Zhejiang University of Science and Technology · Zhejiang University of Technology
    PDF ↗
  18. 2022
    Continuous learning of spiking networks trained with local rulesDmitry Antonov, Kirill Sviatov, Sergey SukhovNeural Networks · Kotelnikov Institute of Radioengineering and Electronics of the Russian Academy of Sciences · Ulyanovsk State Technical University
    PDF ↗
  19. 2022
    Online Lifelong Generalized Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramNeural Networks · Agency for Science, Technology and Research · Institute for Infocomm Research · +2
    PDF ↗
  20. 2022
    Return of the normal distribution: Flexible deep continual learning with variational auto-encodersYongwon Hong, Martin Mundt, Sungho Park … Hyeran ByunNeural Networks · Yonsei University · Technische Universität Darmstadt · +1
  21. 2023
    Continual Object Detection: A review of definitions, strategies, and challengesAngelo Garangau Menezes, Gustavo de Moura, Cézanne Alves, André C. P. L. F. de CarvalhoNeural Networks
    PDF ↗
  22. 2024
    Continual Pre-Training Mitigates Forgetting in Language and VisionAndrea Cossu, Tinne Tuytelaars, Antonio Carta … Davide BacciuNeural Networks
    PDF ↗
  23. 2023
    Generative Negative Replay for Continual LearningGabriele Graffieti, Davide Maltoni, Lorenzo Pellegrini, Vincenzo LomonacoNeural Networks
    PDF ↗
  24. 2022
    Lifelong 3D Object Recognition and Grasp Synthesis Using Dual Memory Recurrent Self-Organization NetworksKrishnakumar Santhakumar, Hamidreza KasaeiNeural Networks · University of Groningen
    PDF ↗
  25. 2022
    Deep Bayesian Unsupervised Lifelong LearningTingting Zhao, Zifeng Wang, Aria Masoomi, Jennifer DyNeural Networks · Bryant University · Bryan College · +1
    PDF ↗
  26. 2023
    A biologically inspired architecture with switching units can learn to generalize across backgroundsDoris Voina, Eric Shea‐Brown, Ştefan MihalaşNeural Networks · University of Washington · University of Washington Applied Physics Laboratory · +2
  27. 2021
    Structured Ensembles: an Approach to Reduce the Memory Footprint of Ensemble MethodsJary Pomponi, Simone Scardapane, Aurelio UnciniNeural Networks · Sapienza University of Rome
    PDF ↗
  28. 2021
    Schematic Memory Persistence and Transience for Efficient and Robust Continual LearningYuyang Gao, Giorgio A. Ascoli, Liang ZhaoNeural Networks · Emory University · George Mason University · +2
    PDF ↗
  29. 2021
    Continual Learning for Recurrent Neural Networks: an Empirical EvaluationAndrea Cossu, Antonio Carta, Vincenzo Lomonaco, Davide BacciuNeural Networks · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  30. 2022
    Using top-down modulation to optimally balance shared versus separated task representationsPieter Verbeke, Tom VergutsNeural Networks · Ghent University Hospital
  31. 2021
    A Comprehensive Study of Class Incremental Learning Algorithms for Visual TasksEden Belouadah, Adrian Popescu, Ioannis KanellosNeural Networks · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · +2
    PDF ↗
  32. 2020
    Encoding primitives generation policy learning for robotic arm to overcome catastrophic forgetting in sequential multi-tasks learningFangzhou Xiong, Zhiyong Liu, Kaizhu Huang … Amir HussainNeural Networks · Shandong Institute of Automation · Institute of Automation · +7
  33. 2020
    Progressive learning: A deep learning framework for continual learningHaytham M. Fayek, Lawrence Cavedon, Hong Ren WuNeural Networks · RMIT University
  34. 2019
    Uncertainty-based modulation for lifelong learningAndrew Brna, Ryan C. Brown, Patrick Connolly … Mario Aguilar-SimonNeural Networks · Triangle · Teledyne Technologies (United States)
    PDF ↗
  35. 2020
    Tree-CNN: A hierarchical Deep Convolutional Neural Network for incremental learningDeboleena Roy, Priyadarshini Panda, Kaushik RoyNeural Networks · Purdue University West Lafayette
    PDF ↗
  36. 2019
    Continuous Learning in Single-Incremental-Task ScenariosDavide Maltoni, Vincenzo LomonacoNeural Networks · University of Bologna
    PDF ↗
  37. 2018
    Born to Learn: the Inspiration, Progress, and Future of Evolved Plastic Artificial Neural NetworksAndrea Soltoggio, Kenneth O. Stanley, Sebastian RisiNeural Networks · Loughborough University · University of Central Florida · +1
    PDF ↗
  38. 2019
    Continual Lifelong Learning with Neural Networks: A ReviewG. I. Parisi, Ronald Kemker, Jose L. Part … Stefan WermterNeural Networks
    PDF ↗
  39. 2017
    Lifelong learning of human actions with deep neural network self-organizationGerman I. Parisi, Jun Tani, Cornelius Weber, Stefan WermterNeural Networks · Universität Hamburg · Hamburg University of Technology · +1
  40. 1998
    Distributed ARTMAP: a neural network for fast distributed supervised learningGail A. Carpenter, Boriana L. Milenova, Benjamin W. NoeskeNeural Networks · Boston University · Adaptive Cognitive Systems
  41. 1997
  42. 1996
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.