Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

54 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2021
    Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen‐Yu Lee … Tomas PfisterCVPR · Universidad del Noreste · Google (United States)
    PDF ↗
  2. 2021
    DyTox: Transformers for Continual Learning with DYnamic TOken eXpansionArthur Douillard, Alexandre Ramé, Guillaume Couairon, Matthieu CordCVPR · Sorbonne Université · Valeo (France)
    PDF ↗
  3. 2021
    Self-Supervised Models are Continual LearnersEnrico Fini, Victor G. Turrisi da Costa, Xavier Alameda-Pineda … Julien MairalCVPR · University of Trento · Institut national de recherche en sciences et technologies du numérique · +1
    PDF ↗
  4. 2021
    Rethinking Architecture Design for Tackling Data Heterogeneity in Federated LearningLiangqiong Qu, Yuyin Zhou, Paul Pu Liang … Daniel L. RubinCVPR · Stanford University · University of California, Santa Cruz · +2
    PDF ↗
  5. 2021
    GCR: Gradient Coreset based Replay Buffer Selection for Continual LearningRishabh Tiwari, Krishnateja Killamsetty, Rishabh Iyer, Pradeep ShenoyCVPR · Indian Institute of Technology Dhanbad · The University of Texas at Dallas
    PDF ↗
  6. 2021
    Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental LearningYujun Shi, Kuangqi Zhou, Jian Liang … Vincent Y. F. TanCVPR · National University of Singapore · Chinese Academy of Sciences · +1
    PDF ↗
  7. 2021
    Towards Better Plasticity-Stability Trade-off in Incremental Learning: A Simple Linear ConnectorGuoliang Lin, Hanlu Chu, Hanjiang LaiCVPR · Sun Yat-sen University · South China Normal University
    PDF ↗
  8. 2021
    Incremental Learning in Semantic Segmentation from Image LabelsFabio Cermelli, Dario Fontanel, Antonio Tavera … Barbara CaputoCVPR · Politecnico di Torino · Italian Institute of Technology
    PDF ↗
  9. 2021
    Continually Learning Self-Supervised Representations with Projected Functional RegularizationAlex Gomez-Villa, Bartłomiej Twardowski, Yu Lu … Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · Tianjin University of Technology · +1
    PDF ↗
  10. 2021
    Ex-Model: Continual Learning from a Stream of Trained ModelsAntonio Carta, Andrea Cossu, Vincenzo Lomonaco, Davide BacciuCVPR · University of Pisa · Scuola Normale Superiore
    PDF ↗
  11. 2021
    DO-GAN: A Double Oracle Framework for Generative Adversarial NetworksAye Phyu Phyu Aung, Xinrun Wang, Runsheng Yu … Xiaoli LiCVPR · Agency for Science, Technology and Research · Nanyang Technological University · +1
    PDF ↗
  12. 2021
    CSG0: Continual Urban Scene Generation with Zero ForgettingHimalaya Jain, Tuan-Hung Vu, Patrick Pérez, Matthieu CordCVPR · Valeo (France)
    PDF ↗
  13. 2021
    DER: Dynamically Expandable Representation for Class Incremental LearningShipeng Yan, Jiangwei Xie, Xuming HeCVPR · ShanghaiTech University · Shanghai Institute of Microsystem and Information Technology · +1
    PDF ↗
  14. 2021
    Prototype Augmentation and Self-Supervision for Incremental LearningFei Zhu, Xu-Yao Zhang, Chuang Wang … Cheng‐Lin LiuCVPR · Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence · +3
  15. 2021
    Rainbow Memory: Continual Learning with a Memory of Diverse SamplesJihwan Bang, Heesu Kim, Youngjoon Yoo … Jonghyun ChoiCVPR · NAVER Cloud (South Korea) · Naver (South Korea) · +1
    PDF ↗
  16. 2021
    Few-Shot Incremental Learning with Continually Evolved ClassifiersChi Zhang, Nan Song, Guosheng Lin … Yinghui XuCVPR · Nanyang Technological University · Alibaba Group (Cayman Islands)
    PDF ↗
  17. 2021PDF ↗
  18. 2021
    Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental LearningAli Cheraghian, Shafin Rahman, Pengfei Fang … Mehrtash HarandiCVPR · Australian National University · Commonwealth Scientific and Industrial Research Organisation · +3
    PDF ↗
  19. 2021
    Training Networks in Null Space of Feature Covariance for Continual LearningShipeng Wang, Xiaorong Li, Jian Sun, Zongben XuCVPR · Xi'an Jiaotong University
    PDF ↗
  20. 2021
    Avalanche: an End-to-End Library for Continual LearningVincenzo Lomonaco, Lorenzo Pellegrini, Andrea Cossu … Davide MaltoniCVPR · University of Pisa · University of Bologna · +12
    PDF ↗
  21. 2021
    Distilling Causal Effect of Data in Class-Incremental LearningXinting Hu, Kaihua Tang, Chunyan Miao … Hanwang ZhangCVPR · Nanyang Technological University · Alibaba Group (Cayman Islands)
    PDF ↗
  22. 2021
    Self-Promoted Prototype Refinement for Few-Shot Class-Incremental LearningKai Zhu, Yang Cao, Wei Zhai … Zheng-Jun ZhaCVPR · University of Science and Technology of China · Huawei Technologies (United Kingdom)
    PDF ↗
  23. 2021PDF ↗
  24. 2021
    On Learning the Geodesic Path for Incremental LearningChristian Simon, Piotr Koniusz, Mehrtash HarandiCVPR · Australian National University · Commonwealth Scientific and Industrial Research Organisation · +3
    PDF ↗
  25. 2021
    Network Pruning via Performance MaximizationShangqian Gao, Feihu Huang, Weidong Cai, Heng HuangCVPR · University of Pittsburgh · The University of Sydney
  26. 2021
    Essentials for Class Incremental LearningSudhanshu Mittal, Silvio Galesso, Thomas BroxCVPR · University of Freiburg
    PDF ↗
  27. 2021
    FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation LearningMinha Kim, Shahroz Tariq, Simon S. WooCVPR · Sungkyunkwan University
    PDF ↗
  28. 2021
    ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual LearningLiyuan Wang, Kuo Yang, Chongxuan Li … Jun ZhuCVPR · Tsinghua University · Huawei Technologies (Sweden)
    PDF ↗
  29. 2021
    Layerwise Optimization by Gradient Decomposition for Continual LearningShixiang Tang, Dapeng Chen, Jinguo Zhu … Wanli OuyangCVPR · The University of Sydney · Group Sense (China) · +2
    PDF ↗
  30. 2021
    Efficient Feature Transformations for Discriminative and Generative Continual LearningVinay Kumar Verma, Kevin J Liang, Nikhil Mehta … Lawrence CarinCVPR · Duke University · Indian Institute of Technology Kanpur
    PDF ↗
  31. 2021
    Class-Incremental Learning with Generative ClassifiersGido M. van de Ven, Zhe Li, Andreas S. ToliasCVPR · Baylor College of Medicine
    PDF ↗
  32. 2021
    ATSO: Asynchronous Teacher-Student Optimization for Semi-Supervised Image SegmentationXinyue Huo, Lingxi Xie, Jianzhong He … Qi TianCVPR · University of Science and Technology of China · Chinese Academy of Sciences
  33. 2021
    Image De-raining via Continual LearningMan Zhou, Jie Xiao, Yifan Chang … Zheng-Jun ZhaCVPR · University of Science and Technology of China · Nanjing University of Science and Technology
  34. 2021
    DyStaB: Unsupervised Object Segmentation via Dynamic-Static Bootstrapping*Yanchao Yang, Brian Lai, Stefano SoattoCVPR · Stanford University
  35. 2021
    Continual Learning via Bit-Level Information PreservingYujun Shi, Li Yuan, Yunpeng Chen, Jiashi FengCVPR · National University of Singapore
    PDF ↗
  36. 2021
    Rectification-based Knowledge Retention for Continual LearningPravendra Singh, Pratik Mazumder, Piyush Rai, Vinay P. NamboodiriCVPR · Indian Institute of Technology Kanpur · University of Bath
    PDF ↗
  37. 2021
    Incremental Learning via Rate ReductionZiyang Wu, Christina Baek, Chong You, Yi MaCVPR · Cornell University · Berkeley College · +1
    PDF ↗
  38. 2021
    Dual-Teacher Class-Incremental Learning With Data-Free Generative ReplayYoojin Choi, Mostafa El‐Khamy, Jungwon LeeCVPR · Samsung (United States) · Samsung (South Korea)
    PDF ↗
  39. 2021
    Hyper-LifelongGAN: Scalable Lifelong Learning for Image Conditioned GenerationMengyao Zhai, Lei Chen, Greg MoriCVPR · Simon Fraser University
  40. 2021
    Learning the Superpixel in a Non-iterative and Lifelong MannerLei Zhu, Qi She, Bin Zhang … Jie HuCVPR · Beijing University of Posts and Telecommunications · Peking University
    PDF ↗
  41. 2021
    Class-Incremental Experience Replay for Continual Learning under Concept DriftŁukasz Korycki, Bartosz KrawczykCVPR · Virginia Commonwealth University
    PDF ↗
  42. 2021
    Ternary Feature Masks: zero-forgetting for task-incremental learningMarc Masana, Tinne Tuytelaars, Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · Barcelona Supercomputing Center · +2
    PDF ↗
  43. 2021
    Selective Replay Enhances Learning in Online Continual Analogical ReasoningTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology · Cornell University · +1
    PDF ↗
  44. 2021
    A Tale of Two CILs: The Connections between Class Incremental Learning and Class Imbalanced Learning, and BeyondChen He, Ruiping Wang, Xilin ChenCVPR · Chinese Academy of Sciences · Institute of Computing Technology · +1
  45. 2021
    Continual learning in cross-modal retrievalKai Wang, Luis Herranz, Joost van de WeijerCVPR · Universitat Autònoma de Barcelona
    PDF ↗
  46. 2021
    ILCOC: An Incremental Learning Framework based on Contrastive One-class ClassifiersWenju Sun, Jing Zhang, Danyu Wang … Qingyong LiCVPR · Beijing Jiaotong University
  47. 2021
    IB-DRR - Incremental Learning with Information-Back Discrete Representation ReplayJiang Jian, Edoardo Cetin, Oya ÇeliktutanCVPR · King's College London
    PDF ↗
  48. 2021
    On the Robustness and Generalizability of Face Synthesis Detection MethodsJohan Sabel, Fredrik JohanssonCVPR · Swedish Defence Research Agency
  49. 2021
    Neural Architecture Search of Deep Priors: Towards Continual Learning without Catastrophic InterferenceMartin Mundt, Iuliia Pliushch, Visvanathan RameshCVPR · Goethe University Frankfurt
    PDF ↗
  50. 2021
    CL-Gym: Full-Featured PyTorch Library for Continual LearningSeyed Iman Mirzadeh, Hassan GhasemzadehCVPR · Washington State University
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.