Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

442 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2021
    Recent Advances of Continual Learning in Computer Vision: An OverviewHaoxuan Qu, Hossein Rahmani, Li Xu … Jun LiuIET Computer Vision · Lancaster University · Singapore University of Technology and Design
    PDF ↗
  2. 2021
    Continual Learning With Quasi-Newton MethodsSteven Vander Eeckt, Hugo Van hammeIEEE Access · KU Leuven
    PDF ↗
  3. 2021
    Generative feature-driven image replay for continual learningKevin Thandiackal, Tiziano Portenier, Andrea Giovannini … Orçun GökselImage and Vision Computing · ETH Zurich · IBM Research - Zurich · +1
    PDF ↗
  4. 2021
    Simultaneous Multi-View Object Recognition and Grasping in Open-Ended DomainsHamidreza Kasaei, Mohammadreza Kasaei, Georgios Tziafas … Remo SassoJournal of Intelligent & Robotic Systems · University of Groningen · University of Edinburgh
    PDF ↗
  5. 2021
    Task-Specific Normalization for Continual Learning of Blind Image Quality ModelsWeixia Zhang, Kede Ma, Guangtao Zhai, Xiaokang YangTIP · Shanghai Jiao Tong University · City University of Hong Kong · +1
    PDF ↗
  6. 2021
    Relational Experience Replay: Continual Learning by Adaptively Tuning Task-Wise RelationshipQuanziang Wang, Renzhen Wang, Yuexiang Li … Deyu MengIEEE Trans. Multimedia · Xi'an Jiaotong University · Tencent (China) · +1
    PDF ↗
  7. 2021
    Tuned Compositional Feature Replays for Efficient Stream LearningMorgan B. Talbot, Rushikesh Zawar, Rohil Badkundri … Gabriel KreimanTNNLS · Boston Children's Hospital · Harvard–MIT Division of Health Sciences and Technology · +6
    PDF ↗
  8. 2021
    Continual Learning: Fast and SlowQuang Pham, Chenghao Liu, Steven C. H. HoiTPAMI · Institute for Infocomm Research · Singapore Management University
    PDF ↗
  9. 2021
    Prototype-Guided Memory Replay for Continual LearningStella Ho, Ming Liu, Lan Du … Yong XiangTNNLS · Deakin University · Monash University · +1
    PDF ↗
  10. 2021
    RMM: Reinforced Memory Management for Class-Incremental LearningYaoyao Liu, Bernt Schiele, Qianru SunNeurIPS
    PDF ↗
  11. 2021
    An Incremental Learning Model for Mobile Robot: From Short-Term Memory to Long-Term MemoryDongshu Wang, Kai Yang, Lei Liu, Heshan WangIEEE TAI · Zhengzhou University · China Mobile (China) · +1
  12. 2021PDF ↗
  13. 2021
    Embodied Learning for Lifelong Visual PerceptionDavid Nilsson, Aleksis Pirinen, Erik Gärtner, Cristian SminchisescuarXiv
    PDF ↗
  14. 2021
    Generative Kernel Continual learningMohammad Mahdi Derakhshani, Xiantong Zhen, Ling Shao, Cees G. M. SnoekarXiv
    PDF ↗
  15. 2021
    DILF-EN framework for Class-Incremental LearningMohammed Asad Karim, Indu Joshi, Pratik Mazumder, Pravendra SingharXiv
    PDF ↗
  16. 2021
    How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?Dong, Xinhsuai, Tuan, Luu Anh, Min Lin … Hanwang ZhangNeurIPS
    PDF ↗
  17. 2021
    Continual Neural Network Model RetrainingXiaofeng Zhu, Diego KlabjanIEEE International Conference on Big Data (Big Data) · Microsoft (United States) · Northwestern University
  18. 2021PDF ↗
  19. 2021
    Modeling nuisance classifier towards class-incremental learning of crowd-sourced dataRamesh Ashok Tabib, T. Santoshkumar, Dikshit Hegde … Uma MudenagudiTwelfth Indian Conference on Computer Vision, Graphics an… · KLE Technological University
  20. 2021
    Incremental Learning for End-to-End Automatic Speech RecognitionLi Fu, Xiaoxiao Li, Libo Zi … Bowen ZhouIEEE Automatic Speech Recognition and Understanding Works… · Jingdong (China)
    PDF ↗
  21. 2021
    Improving Vision Transformers for Incremental LearningPei Yu, Yinpeng Chen, Ying Jin, Zicheng LiuarXiv
    PDF ↗
  22. 2021
    Gradient-matching coresets for continual learningLukas Balles, Giovanni Zappella, Cédric ArchambeauarXiv
    PDF ↗
  23. 2021
    Cost-Effective Incremental Deep Model: Matching Model Capacity With the Least SamplingYang Yang, Da-Wei Zhou, De-Chuan Zhan … Jian YangTKDE · Nanjing University of Science and Technology · Southeast University · +2
  24. 2021PDF ↗
  25. 2021
    Overcome Anterograde Forgetting with Cycled Memory NetworksJian Peng, Dingqi Ye, Bo Tang … Haifeng LiarXiv
    PDF ↗
  26. 2021
    Meta-learning synaptic plasticity and memory addressing for continual familiarity detectionDanil Tyulmankov, Guangyu Robert Yang, L. F. AbbottNeuron · Columbia University · Allen Institute for Brain Science · +1
  27. 2021
    Continual Learning for Multivariate Time Series Tasks with Variable Input DimensionsVibhor Gupta, Jyoti Narwariya, Pankaj Malhotra … Gautam ShroffICDM
    PDF ↗
  28. 2021
    Few-Shot Class-Incremental Learning with Meta-Learned Class StructuresGuangtao Zheng, Aidong ZhangICDM · University of Virginia
  29. 2021
    Evaluating and Explaining Generative Adversarial Networks for Continual Learning under Concept DriftFilip Guzy, Michał Woźniak, Bartosz KrawczykICDM · University of Science and Technology · AGH University of Krakow · +1
  30. 2021
    Two-Branch Attention Learning for Fine-Grained Class Incremental LearningJiaqi Guo, Guanqiu Qi, Xie Shuiqing, Xiangyuan LiElectronics · South Central Minzu University · Buffalo State University · +1
  31. 2021
    Conflicts between Likelihood and Knowledge Distillation in Task Incremental Learning for 3D Object DetectionYun Peng, Jun Cen, Ming LiuInternational Conference on 3D Vision (3DV) · Hong Kong University of Science and Technology
  32. 2021
    Structural Knowledge Organization and Transfer for Class-Incremental LearningYu Liu, Xiaopeng Hong, Xiaoyu Tao … Yihong GongACM MM · Xi'an Jiaotong University
  33. 2021
    Impact Patterns of Combining Model Pruning and Continual Learning on Model PerformanceXueyang Zhang, Hang Li, Xi Chen, Xue LiuIEEE Third International Conference on Cognitive Machine… · McGill University
  34. 2021
    SGDOL: Self-evolving Generative and Discriminative Online Learning for Data Stream ClassificationDeeksha Aggarwal, J. Senthilnath, Uttam Kumar … Xiaoli LiICDM · International Institute of Information Technology Bangalore · Agency for Science, Technology and Research · +2
  35. 2021
    The Role Weights Play in Catastrophic ForgettingArend HintzeInternational Conference on Soft Computing & Machine… · Dalarna University
  36. 2021
    On-the-fly Learning of New Objects and InstancesPing Guo, Zhigang Wang, Hua Yang … Yimin ZhangInternational Conference on Mechatronics and Machine Visi…
  37. 2021
    CVPR 2020 Continual Learning in Computer Vision Competition: Approaches, Results, Current Challenges and Future DirectionsVincenzo Lomonaco, Lorenzo Pellegrini, Pau Rodríguez … Davide MaltoniArtificial Intelligence · University of Bologna · Mila - Quebec Artificial Intelligence Institute · +7
    PDF ↗
  38. 2021
    Reviewing continual learning from the perspective of human-level intelligenceYifan Chang, Wenbo Li, Jian Peng … Haifeng LiarXiv
    PDF ↗
  39. 2021
    Incremental sequential three-way decision based on continual learning networkHongyuan Li, Hong Yu, Hong Yu … Huaxiong LiInternational Journal of Machine Learning and Cybernetics · Nanjing University · Chongqing University of Posts and Telecommunications · +2
  40. 2021
    Learning by Active Forgetting for Neural NetworksJian Peng, Xian Sun, Min Deng … Haifeng LiarXiv · Central South University
    PDF ↗
  41. 2021
    Beyond gradients: Factorized, geometric control of interference and generalizationDavid M. Scott, Michael J. FrankbioRxiv · Brown University · Allen Institute for Brain Science
  42. 2021
    Defeating Catastrophic Forgetting via Enhanced Orthogonal Weights ModificationYanni Li, Bing Liu, Kaicheng Yao … Jiangtao CuiarXiv
    PDF ↗
  43. 2021
    Lifelong Reinforcement Learning with Temporal Logic Formulas and Reward MachinesXuejing Zheng, Chao Yu, Chen Chen … Hankz Hankui ZhuoarXiv
    PDF ↗
  44. 2021
    Self-Supervised Class Incremental LearningZixuan Ni, Siliang Tang, Yueting ZhuangarXiv
    PDF ↗
  45. 2021
    Continual Learning via Local Module CompositionOleksiy Ostapenko, Pau Rodríguez, M. Caccia, Laurent CharlinNeurIPS · Taras Shevchenko National University of Kyiv · University of Insubria · +1
    PDF ↗
  46. 2021
    Target Layer Regularization for Continual Learning Using Cramer-Wold GeneratorMarcin Mazur, Łukasz Pustelnik, Szymon Knop … Przemysław SpurekarXiv
    PDF ↗
  47. 2021
    Kronecker Factorization for Preventing Catastrophic Forgetting in Large-scale Medical Entity LinkingDenis Jered McInerney, Luyang Kong, Kristjan Arumae … Parminder BhatiaarXiv · Universidad del Noreste · Amazon (Germany)
    PDF ↗
  48. 2021
    Reactive Multi-Fitness Learning for Robust Multiagent TeamingConnor Yates, Ayhan Alp Aydeniz, Kagan TumerInternational Symposium on Multi-Robot and Multi-Agent Sy… · Oregon State University
  49. 2021PDF ↗
  50. 2021
    One Pass ImageNetHuiyi Hu, Ang Li, Daniele Calandriello, Dilan GörürarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.