Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

43 papers of 8,653Sort Recent · Most cited
  1. 2021
    DER: Dynamically Expandable Representation for Class Incremental LearningShipeng Yan, Jiangwei Xie, Xuming HeCVPR · ShanghaiTech University · Shanghai Institute of Microsystem and Information Technology · +1
    PDF ↗
  2. 2021
    Prototype Augmentation and Self-Supervision for Incremental LearningFei Zhu, Xu-Yao Zhang, Chuang Wang … Cheng‐Lin LiuCVPR · Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence · +3
  3. 2021
    Rainbow Memory: Continual Learning with a Memory of Diverse SamplesJihwan Bang, Heesu Kim, Youngjoon Yoo … Jonghyun ChoiCVPR · NAVER Cloud (South Korea) · Naver (South Korea) · +1
    PDF ↗
  4. 2021
    Few-Shot Incremental Learning with Continually Evolved ClassifiersChi Zhang, Nan Song, Guosheng Lin … Yinghui XuCVPR · Nanyang Technological University · Alibaba Group (Cayman Islands)
    PDF ↗
  5. 2021
    PLOP: Learning without Forgetting for Continual Semantic SegmentationArthur Douillard, Yifu Chen, Arnaud Dapogny, Matthieu CordCVPR · Sorbonne Université · Laboratoire Médiations · +1
    PDF ↗
  6. 2021
    Adaptive Aggregation Networks for Class-Incremental LearningYaoyao Liu, Bernt Schiele, Qianru SunCVPR · Max Planck Institute for Informatics · Singapore Management University
    PDF ↗
  7. 2021PDF ↗
  8. 2021
    Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental LearningAli Cheraghian, Shafin Rahman, Pengfei Fang … Mehrtash HarandiCVPR · Australian National University · Commonwealth Scientific and Industrial Research Organisation · +3
    PDF ↗
  9. 2021
    Training Networks in Null Space of Feature Covariance for Continual LearningShipeng Wang, Xiaorong Li, Jian Sun, Zongben XuCVPR · Xi'an Jiaotong University
    PDF ↗
  10. 2021
    Avalanche: an End-to-End Library for Continual LearningVincenzo Lomonaco, Lorenzo Pellegrini, Andrea Cossu … Davide MaltoniCVPR · University of Pisa · University of Bologna · +12
    PDF ↗
  11. 2021
    Distilling Causal Effect of Data in Class-Incremental LearningXinting Hu, Kaihua Tang, Chunyan Miao … Hanwang ZhangCVPR · Nanyang Technological University · Alibaba Group (Cayman Islands)
    PDF ↗
  12. 2021
    Self-Promoted Prototype Refinement for Few-Shot Class-Incremental LearningKai Zhu, Yang Cao, Wei Zhai … Zheng-Jun ZhaCVPR · University of Science and Technology of China · Huawei Technologies (United Kingdom)
    PDF ↗
  13. 2021PDF ↗
  14. 2021
    On Learning the Geodesic Path for Incremental LearningChristian Simon, Piotr Koniusz, Mehrtash HarandiCVPR · Australian National University · Commonwealth Scientific and Industrial Research Organisation · +3
    PDF ↗
  15. 2021
    Lifelong Person Re-Identification via Adaptive Knowledge AccumulationNan Pu, Wei Chen, Yu Liu … Michael S. LewCVPR · Leiden University · Dalian University of Technology
    PDF ↗
  16. 2021
    Essentials for Class Incremental LearningSudhanshu Mittal, Silvio Galesso, Thomas BroxCVPR · University of Freiburg
    PDF ↗
  17. 2021
    ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual LearningLiyuan Wang, Kuo Yang, Chongxuan Li … Jun ZhuCVPR · Tsinghua University · Huawei Technologies (Sweden)
    PDF ↗
  18. 2021
    Layerwise Optimization by Gradient Decomposition for Continual LearningShixiang Tang, Dapeng Chen, Jinguo Zhu … Wanli OuyangCVPR · The University of Sydney · Group Sense (China) · +2
    PDF ↗
  19. 2021
    Efficient Feature Transformations for Discriminative and Generative Continual LearningVinay Kumar Verma, Kevin J Liang, Nikhil Mehta … Lawrence CarinCVPR · Duke University · Indian Institute of Technology Kanpur
    PDF ↗
  20. 2021
    Continual Adaptation of Visual Representations via Domain Randomization and Meta-learningRiccardo Volpi, Diane Larlus, Grégory RogezCVPR · Naver (South Korea)
    PDF ↗
  21. 2021
    Class-Incremental Learning with Generative ClassifiersGido M. van de Ven, Zhe Li, Andreas S. ToliasCVPR · Baylor College of Medicine
    PDF ↗
  22. 2021
    Image De-raining via Continual LearningMan Zhou, Jie Xiao, Yifan Chang … Zheng-Jun ZhaCVPR · University of Science and Technology of China · Nanjing University of Science and Technology
  23. 2021
    Continual Learning via Bit-Level Information PreservingYujun Shi, Li Yuan, Yunpeng Chen, Jiashi FengCVPR · National University of Singapore
    PDF ↗
  24. 2021
    Rectification-based Knowledge Retention for Continual LearningPravendra Singh, Pratik Mazumder, Piyush Rai, Vinay P. NamboodiriCVPR · Indian Institute of Technology Kanpur · University of Bath
    PDF ↗
  25. 2021
    Incremental Learning via Rate ReductionZiyang Wu, Christina Baek, Chong You, Yi MaCVPR · Cornell University · Berkeley College · +1
    PDF ↗
  26. 2021
    Dual-Teacher Class-Incremental Learning With Data-Free Generative ReplayYoojin Choi, Mostafa El‐Khamy, Jungwon LeeCVPR · Samsung (United States) · Samsung (South Korea)
    PDF ↗
  27. 2021
    Hyper-LifelongGAN: Scalable Lifelong Learning for Image Conditioned GenerationMengyao Zhai, Lei Chen, Greg MoriCVPR · Simon Fraser University
  28. 2021
    Class-Incremental Experience Replay for Continual Learning under Concept DriftŁukasz Korycki, Bartosz KrawczykCVPR · Virginia Commonwealth University
    PDF ↗
  29. 2021
    Ternary Feature Masks: zero-forgetting for task-incremental learningMarc Masana, Tinne Tuytelaars, Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · Barcelona Supercomputing Center · +2
    PDF ↗
  30. 2021
    IIRC: Incremental Implicitly-Refined ClassificationMohamed Abdelsalam, Mojtaba Faramarzi, Shagun Sodhani, Sarath ChandarCVPR · Mila - Quebec Artificial Intelligence Institute · Université de Montréal · +3
    PDF ↗
  31. 2021
    Selective Replay Enhances Learning in Online Continual Analogical ReasoningTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology · Cornell University · +1
    PDF ↗
  32. 2021
    A Tale of Two CILs: The Connections between Class Incremental Learning and Class Imbalanced Learning, and BeyondChen He, Ruiping Wang, Xilin ChenCVPR · Chinese Academy of Sciences · Institute of Computing Technology · +1
  33. 2021
    Continual learning in cross-modal retrievalKai Wang, Luis Herranz, Joost van de WeijerCVPR · Universitat Autònoma de Barcelona
    PDF ↗
  34. 2021
    ILCOC: An Incremental Learning Framework based on Contrastive One-class ClassifiersWenju Sun, Jing Zhang, Danyu Wang … Qingyong LiCVPR · Beijing Jiaotong University
  35. 2021
    IB-DRR - Incremental Learning with Information-Back Discrete Representation ReplayJiang Jian, Edoardo Cetin, Oya ÇeliktutanCVPR · King's College London
    PDF ↗
  36. 2021
    KSM: Fast Multiple Task Adaption via Kernel-wise Soft Mask LearningLi Yang, Zhezhi He, Junshan Zhang, Deliang FanCVPR · Arizona State University
    PDF ↗
  37. 2021
    Insights from the Future for Continual LearningArthur Douillard, Eduardo Valle, Charles Ollion … Matthieu CordCVPR · Sorbonne Université · Universidade Estadual de Campinas (UNICAMP)
    PDF ↗
  38. 2021
    Neural Architecture Search of Deep Priors: Towards Continual Learning without Catastrophic InterferenceMartin Mundt, Iuliia Pliushch, Visvanathan RameshCVPR · Goethe University Frankfurt
    PDF ↗
  39. 2021
    CL-Gym: Full-Featured PyTorch Library for Continual LearningSeyed Iman Mirzadeh, Hassan GhasemzadehCVPR · Washington State University
  40. 2021
    DANICE: Domain adaptation without forgetting in neural image compressionSudeep Katakol, Luis Herranz, Fei Yang, Marta MrakCVPR · University of Michigan · Umbo Computer Vision (United Kingdom) · +1
    PDF ↗
  41. 2021
    Plastic and Stable Gated Classifiers for Continual LearningNicholas I-Hsien Kuo, Mehrtash Harandi, Nicolas Fourrier … Hanna SuominenCVPR · Australian National University · UNSW Sydney · +5
  42. 2021PDF ↗
  43. 2021
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.