Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

76 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2021PDF ↗
  2. 2021
    Embodied Learning for Lifelong Visual PerceptionDavid Nilsson, Aleksis Pirinen, Erik Gärtner, Cristian SminchisescuarXiv
    PDF ↗
  3. 2021
    Generative Kernel Continual learningMohammad Mahdi Derakhshani, Xiantong Zhen, Ling Shao, Cees G. M. SnoekarXiv
    PDF ↗
  4. 2021
    DILF-EN framework for Class-Incremental LearningMohammed Asad Karim, Indu Joshi, Pratik Mazumder, Pravendra SingharXiv
    PDF ↗
  5. 2021PDF ↗
  6. 2021
    Improving Vision Transformers for Incremental LearningPei Yu, Yinpeng Chen, Ying Jin, Zicheng LiuarXiv
    PDF ↗
  7. 2021
    Gradient-matching coresets for continual learningLukas Balles, Giovanni Zappella, Cédric ArchambeauarXiv
    PDF ↗
  8. 2021
    Overcome Anterograde Forgetting with Cycled Memory NetworksJian Peng, Dingqi Ye, Bo Tang … Haifeng LiarXiv
    PDF ↗
  9. 2021
    Reviewing continual learning from the perspective of human-level intelligenceYifan Chang, Wenbo Li, Jian Peng … Haifeng LiarXiv
    PDF ↗
  10. 2021
    Learning by Active Forgetting for Neural NetworksJian Peng, Xian Sun, Min Deng … Haifeng LiarXiv · Central South University
    PDF ↗
  11. 2021
    Defeating Catastrophic Forgetting via Enhanced Orthogonal Weights ModificationYanni Li, Bing Liu, Kaicheng Yao … Jiangtao CuiarXiv
    PDF ↗
  12. 2021
    Lifelong Reinforcement Learning with Temporal Logic Formulas and Reward MachinesXuejing Zheng, Chao Yu, Chen Chen … Hankz Hankui ZhuoarXiv
    PDF ↗
  13. 2021
    Self-Supervised Class Incremental LearningZixuan Ni, Siliang Tang, Yueting ZhuangarXiv
    PDF ↗
  14. 2021
    Target Layer Regularization for Continual Learning Using Cramer-Wold GeneratorMarcin Mazur, Łukasz Pustelnik, Szymon Knop … Przemysław SpurekarXiv
    PDF ↗
  15. 2021
    Kronecker Factorization for Preventing Catastrophic Forgetting in Large-scale Medical Entity LinkingDenis Jered McInerney, Luyang Kong, Kristjan Arumae … Parminder BhatiaarXiv · Universidad del Noreste · Amazon (Germany)
    PDF ↗
  16. 2021PDF ↗
  17. 2021
    One Pass ImageNetHuiyi Hu, Ang Li, Daniele Calandriello, Dilan GörürarXiv
    PDF ↗
  18. 2021PDF ↗
  19. 2021
    Behavioral Experiments for Understanding Catastrophic ForgettingSamuel J. Bell, Neil D. LawrencearXiv · University of Cambridge
    PDF ↗
  20. 2021
    Class Incremental Online Streaming LearningSoumya Banerjee, Vinay Kumar Verma, Toufiq Parag … Vinay P. NamboodiriarXiv · Indian Institute of Technology Kanpur · Duke University · +1
    PDF ↗
  21. 2021
    A Simple Approach to Continual Learning by Transferring Skill ParametersK.R. Zentner, Ryan Julian, Ujjwal Puri … Gaurav S. SukhatmearXiv
    PDF ↗
  22. 2021PDF ↗
  23. 2021
    Dendritic Self-Organizing Maps for Continual LearningKosmas Pinitas, Spyridon Chavlis, Panayiota PoiraziarXiv · Technical University of Crete · Foundation for Research and Technology Hellas
    PDF ↗
  24. 2021
    Carousel Memory: Rethinking the Design of Episodic Memory for Continual LearningSoobee Lee, Minindu Weerakoon, Jonghyun Choi … Myeongjae JeonarXiv · Ulsan National Institute of Science and Technology · Gwangju Institute of Science and Technology · +1
    PDF ↗
  25. 2021
    Hypernetworks for Continual Semi-Supervised LearningDhanajit Brahma, Vinay Kumar Verma, Piyush RaiarXiv · Indian Institute of Technology Kanpur
    PDF ↗
  26. 2021
    GROWN: GRow Only When Necessary for Continual LearningYang, Li, Sen Lin, Junshan Zhang, Deliang FanarXiv
    PDF ↗
  27. 2021
    Towards a theory of out-of-distribution learningJayanta Dey, Ali Geisa, Ronak Mehta … Joshua T. VogelsteinarXiv
    PDF ↗
  28. 2021
    Towards Generalized and Incremental Few-Shot Object DetectionYiting Li, Haiyue Zhu, Jun Ma … Tong Heng LeearXiv
    PDF ↗
  29. 2021PDF ↗
  30. 2021
    Federated Reconnaissance: Efficient, Distributed, Class-Incremental LearningSean M. Hendryx, Dharma Kc, Bradley Walls, Clayton T. MorrisonarXiv · University of Arizona
    PDF ↗
  31. 2021
    Memory-Free Generative Replay For Class-Incremental LearningXiaomeng Xin, Yiran Zhong, Yunzhong Hou … Liang ZhengarXiv
    PDF ↗
  32. 2021PDF ↗
  33. 2021
    Continual learning under domain transfer with sparse synaptic burstingShawn Beaulieu, Jeff Clune, Nick CheneyarXiv · University of Vermont
    PDF ↗
  34. 2021
    A good body is all you need: avoiding catastrophic interference via agent architecture searchJoshua Powers, Ryan Grindle, L. Frati, Josh BongardarXiv · University of Vermont
    PDF ↗
  35. 2021
    Continual Backprop: Stochastic Gradient Descent with Persistent RandomnessShibhansh Dohare, Richard S. Sutton, A. Rupam MahmoodarXiv · University of Alberta
    PDF ↗
  36. 2021
    Lifelong Intent Detection via Multi-Strategy RebalancingQingbin Liu, Xiaoyan Yu, Shizhu He … Jun ZhaoarXiv
    PDF ↗
  37. 2021
    Sequoia: A Software Framework to Unify Continual Learning ResearchFabrice Normandin, Florian Golemo, Oleksiy Ostapenko … M. CacciaarXiv
    PDF ↗
  38. 2021
    Revisiting Catastrophic Forgetting in Class Incremental LearningZixuan Ni, Haizhou Shi, Siliang Tang … Zhuang, YuetingarXiv · Zhejiang University
    PDF ↗
  39. 2021
    Algorithmic insights on continual learning from fruit fliesYang Shen, Sanjoy Dasgupta, Saket NavlakhaarXiv
    PDF ↗
  40. 2021
    AlterSGD: Finding Flat Minima for Continual Learning by Alternative TrainingZhongzhan Huang, Mingfu Liang, Senwei Liang, Wei HearXiv · Purdue University West Lafayette · Nanyang Technological University
    PDF ↗
  41. 2021PDF ↗
  42. 2021
    A Fixed Version of Quadratic Program in Gradient Episodic MemoryWei Zhou, Yiying LiarXiv · National University of Defense Technology
    PDF ↗
  43. 2021
    Tackling Catastrophic Forgetting and Background Shift in Continual Semantic SegmentationArthur Douillard, Yifu Chen, Arnaud Dapogny, Matthieu CordarXiv · Valeo (France)
    PDF ↗
  44. 2021
    Task-agnostic Continual Learning with Hybrid Probabilistic ModelsPolina Kirichenko, Mehrdad Farajtabar, Dushyant Rao … Razvan PascanuarXiv
    PDF ↗
  45. 2021
    On the importance of cross-task features for class-incremental learningAlbin Soutif--Cormerais, Marc Masana, Joost van de Weijer, Bartłomiej TwardowskiarXiv
    PDF ↗
  46. 2021
    Energy Aligning for Biased ModelsBowen Zhao, Chen Chen, Qi Ju, Shu‐Tao XiaarXiv
    PDF ↗
  47. 2021
    Knowing when we do not know: Bayesian continual learning for sensing-based analysis tasksSandra Servia-Rodríguez, Cecilia Mascolo, Young D. KwonarXiv
    PDF ↗
  48. 2021
    ModelCI-e: Enabling Continual Learning in Deep Learning Serving SystemsYizheng Huang, Huaizheng Zhang, Yonggang Wen … Ta Nguyen Binh DuongarXiv
    PDF ↗
  49. 2021
    Solving hybrid machine learning tasks by traversing weight space geodesicsGuruprasad Raghavan, Matt ThomsonarXiv · California Institute of Technology
    PDF ↗
  50. 2021
    Continual Learning in Deep Networks: an Analysis of the Last LayerTimothée Lesort, Thomas George, Irina RisharXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.