Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

138 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2021PDF ↗
  2. 2021PDF ↗
  3. 2021
    Embodied Learning for Lifelong Visual PerceptionDavid Nilsson, Aleksis Pirinen, Erik Gärtner, Cristian SminchisescuarXiv
    PDF ↗
  4. 2021
    Generative Kernel Continual learningMohammad Mahdi Derakhshani, Xiantong Zhen, Ling Shao, Cees G. M. SnoekarXiv
    PDF ↗
  5. 2021
    DILF-EN framework for Class-Incremental LearningMohammed Asad Karim, Indu Joshi, Pratik Mazumder, Pravendra SingharXiv
    PDF ↗
  6. 2021PDF ↗
  7. 2021PDF ↗
  8. 2021
    Improving Vision Transformers for Incremental LearningPei Yu, Yinpeng Chen, Ying Jin, Zicheng LiuarXiv
    PDF ↗
  9. 2021PDF ↗
  10. 2021PDF ↗
  11. 2021
    Gradient-matching coresets for continual learningLukas Balles, Giovanni Zappella, Cédric ArchambeauarXiv
    PDF ↗
  12. 2021
    Overcome Anterograde Forgetting with Cycled Memory NetworksJian Peng, Dingqi Ye, Bo Tang … Haifeng LiarXiv
    PDF ↗
  13. 2021PDF ↗
  14. 2021PDF ↗
  15. 2021
    Using Fictitious Class Representations to Boost Discriminative Zero-Shot LearnersMohammed Dabbah, Ran El‐YanivarXiv · Technion – Israel Institute of Technology
    PDF ↗
  16. 2021
    Reviewing continual learning from the perspective of human-level intelligenceYifan Chang, Wenbo Li, Jian Peng … Haifeng LiarXiv
    PDF ↗
  17. 2021
    Learning by Active Forgetting for Neural NetworksJian Peng, Xian Sun, Min Deng … Haifeng LiarXiv · Central South University
    PDF ↗
  18. 2021
    Defeating Catastrophic Forgetting via Enhanced Orthogonal Weights ModificationYanni Li, Bing Liu, Kaicheng Yao … Jiangtao CuiarXiv
    PDF ↗
  19. 2021
    Lifelong Reinforcement Learning with Temporal Logic Formulas and Reward MachinesXuejing Zheng, Chao Yu, Chen Chen … Hankz Hankui ZhuoarXiv
    PDF ↗
  20. 2021
    Self-Supervised Class Incremental LearningZixuan Ni, Siliang Tang, Yueting ZhuangarXiv
    PDF ↗
  21. 2021
    Target Layer Regularization for Continual Learning Using Cramer-Wold GeneratorMarcin Mazur, Łukasz Pustelnik, Szymon Knop … Przemysław SpurekarXiv
    PDF ↗
  22. 2021PDF ↗
  23. 2021
    Attention Guided Cosine Margin For Overcoming Class-Imbalance in Few-Shot Road Object DetectionAshutosh Agarwal, Anay Majee, Anbumani Subramanian, Chetan AroraarXiv
    PDF ↗
  24. 2021
    Lightweight machine unlearning in neural networkKongyang Chen, Yiwen Wang, Yao HuangarXiv
    PDF ↗
  25. 2021
    Online Mutual Adaptation of Deep Depth Prediction and Visual SLAMShing Yan Loo, Moein Shakeri, Sai Hong Tang … Hong ZhangarXiv
    PDF ↗
  26. 2021PDF ↗
  27. 2021
    One Pass ImageNetHuiyi Hu, Ang Li, Daniele Calandriello, Dilan GörürarXiv
    PDF ↗
  28. 2021
    A Meta-Learned Neuron model for Continual LearningRodrigue SiryarXiv · Normandie Université · Université de Caen Normandie
    PDF ↗
  29. 2021
    DFCANet: Dense Feature Calibration-Attention Guided Network for Cross Domain Iris Presentation Attack DetectionGaurav Jaswal, Aman Verma, Sumantra Dutta Roy, Raghavendra RamachandraarXiv
    PDF ↗
  30. 2021PDF ↗
  31. 2021PDF ↗
  32. 2021
    Mixture-of-Variational-Experts for Continual LearningHeinke Hihn, Daniel BraunarXiv · Universität Ulm
    PDF ↗
  33. 2021
    Center Loss Regularization for Continual LearningKaustubh Olpadkar, Ekta GavasarXiv
    PDF ↗
  34. 2021
    On Hard Episodes in Meta-LearningS. Basu, Amr Sharaf, Nicoló Fusi, S. FeiziarXiv
    PDF ↗
  35. 2021
    Behavioral Experiments for Understanding Catastrophic ForgettingSamuel J. Bell, Neil D. LawrencearXiv · University of Cambridge
    PDF ↗
  36. 2021
    Class Incremental Online Streaming LearningSoumya Banerjee, Vinay Kumar Verma, Toufiq Parag … Vinay P. NamboodiriarXiv · Indian Institute of Technology Kanpur · Duke University · +1
    PDF ↗
  37. 2021
    Convergence Analysis and Implicit Regularization of Feedback Alignment for Deep Linear NetworksManuela Girotti, Ioannis Mitliagkas, Gauthier GidelarXiv · Université de Montréal
    PDF ↗
  38. 2021
    A Simple Approach to Continual Learning by Transferring Skill ParametersK.R. Zentner, Ryan Julian, Ujjwal Puri … Gaurav S. SukhatmearXiv
    PDF ↗
  39. 2021PDF ↗
  40. 2021
    Dendritic Self-Organizing Maps for Continual LearningKosmas Pinitas, Spyridon Chavlis, Panayiota PoiraziarXiv
    PDF ↗
  41. 2021
    Growing Representation LearningRyan King, Bobak J. MortazaviarXiv
    PDF ↗
  42. 2021
    Carousel Memory: Rethinking the Design of Episodic Memory for Continual LearningSoobee Lee, Minindu Weerakoon, Jonghyun Choi … Myeongjae JeonarXiv · Ulsan National Institute of Science and Technology · Gwangju Institute of Science and Technology · +1
    PDF ↗
  43. 2021
    Sequential Reptile: Inter-Task Gradient Alignment for Multilingual LearningSeanie Lee, Haebeom Lee, Juho Lee, Sung Ju HwangarXiv · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  44. 2021
    Hypernetworks for Continual Semi-Supervised LearningDhanajit Brahma, Vinay Kumar Verma, Piyush RaiarXiv · Indian Institute of Technology Kanpur
    PDF ↗
  45. 2021
    GROWN: GRow Only When Necessary for Continual LearningYang, Li, Sen Lin, Junshan Zhang, Deliang FanarXiv
    PDF ↗
  46. 2021
    Towards a theory of out-of-distribution learningJayanta Dey, Ali Geisa, Ronak Mehta … Joshua T. VogelsteinarXiv
    PDF ↗
  47. 2021
    Dynamic Regret Analysis for Online Meta-LearningParvin Nazari, Esmaile KhorramarXiv · Amirkabir University of Technology
    PDF ↗
  48. 2021
    Bayesian deep learning of affordances from RGB imagesLorenzo Mur-Labadia, Rubén Martínez-CantínarXiv
    PDF ↗
  49. 2021
    Towards Generalized and Incremental Few-Shot Object DetectionYiting Li, Haiyue Zhu, Jun Ma … Tong Heng LeearXiv
    PDF ↗
  50. 2021PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.