Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

532 papers of 6,984 · showing 251–300Sort Recent · Most cited
  1. 2021
    ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual LearningLiyuan Wang, Kuo Yang, Chongxuan Li … Jun ZhuCVPR · Tsinghua University · Huawei Technologies (Sweden)
    PDF ↗
  2. 2021
    Layerwise Optimization by Gradient Decomposition for Continual LearningShixiang Tang, Dapeng Chen, Jinguo Zhu … Wanli OuyangCVPR · The University of Sydney · Group Sense (China) · +2
    PDF ↗
  3. 2021
    Efficient Feature Transformations for Discriminative and Generative Continual LearningVinay Kumar Verma, Kevin J Liang, Nikhil Mehta … Lawrence CarinCVPR · Duke University · Indian Institute of Technology Kanpur
    PDF ↗
  4. 2021
    Continual Adaptation of Visual Representations via Domain Randomization and Meta-learningRiccardo Volpi, Diane Larlus, Grégory RogezCVPR · Naver (South Korea)
    PDF ↗
  5. 2021
    Class-Incremental Learning with Generative ClassifiersGido M. van de Ven, Zhe Li, Andreas S. ToliasCVPR · Baylor College of Medicine
    PDF ↗
  6. 2021
    Image De-raining via Continual LearningMan Zhou, Jie Xiao, Yifan Chang … Zheng-Jun ZhaCVPR · University of Science and Technology of China · Nanjing University of Science and Technology
  7. 2021
    Continual Learning via Bit-Level Information PreservingYujun Shi, Li Yuan, Yunpeng Chen, Jiashi FengCVPR · National University of Singapore
    PDF ↗
  8. 2021
    Rectification-based Knowledge Retention for Continual LearningPravendra Singh, Pratik Mazumder, Piyush Rai, Vinay P. NamboodiriCVPR · Indian Institute of Technology Kanpur · University of Bath
    PDF ↗
  9. 2021
    Incremental Learning via Rate ReductionZiyang Wu, Christina Baek, Chong You, Yi MaCVPR · Cornell University · Berkeley College · +1
    PDF ↗
  10. 2021
    Dual-Teacher Class-Incremental Learning With Data-Free Generative ReplayYoojin Choi, Mostafa El‐Khamy, Jungwon LeeCVPR · Samsung (United States) · Samsung (South Korea)
    PDF ↗
  11. 2021
    Hyper-LifelongGAN: Scalable Lifelong Learning for Image Conditioned GenerationMengyao Zhai, Lei Chen, Greg MoriCVPR · Simon Fraser University
  12. 2021
    Class-Incremental Experience Replay for Continual Learning under Concept DriftŁukasz Korycki, Bartosz KrawczykCVPR · Virginia Commonwealth University
    PDF ↗
  13. 2021
    Ternary Feature Masks: zero-forgetting for task-incremental learningMarc Masana, Tinne Tuytelaars, Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · Barcelona Supercomputing Center · +2
    PDF ↗
  14. 2021
    IIRC: Incremental Implicitly-Refined ClassificationMohamed Abdelsalam, Mojtaba Faramarzi, Shagun Sodhani, Sarath ChandarCVPR · Mila - Quebec Artificial Intelligence Institute · Université de Montréal · +3
    PDF ↗
  15. 2021
    Selective Replay Enhances Learning in Online Continual Analogical ReasoningTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology · Cornell University · +1
    PDF ↗
  16. 2021
    A Tale of Two CILs: The Connections between Class Incremental Learning and Class Imbalanced Learning, and BeyondChen He, Ruiping Wang, Xilin ChenCVPR · Chinese Academy of Sciences · Institute of Computing Technology · +1
  17. 2021
    Continual learning in cross-modal retrievalKai Wang, Luis Herranz, Joost van de WeijerCVPR · Universitat Autònoma de Barcelona
    PDF ↗
  18. 2021
    ILCOC: An Incremental Learning Framework based on Contrastive One-class ClassifiersWenju Sun, Jing Zhang, Danyu Wang … Qingyong LiCVPR · Beijing Jiaotong University
  19. 2021
    IB-DRR - Incremental Learning with Information-Back Discrete Representation ReplayJiang Jian, Edoardo Cetin, Oya ÇeliktutanCVPR · King's College London
    PDF ↗
  20. 2021
    KSM: Fast Multiple Task Adaption via Kernel-wise Soft Mask LearningLi Yang, Zhezhi He, Junshan Zhang, Deliang FanCVPR · Arizona State University
    PDF ↗
  21. 2021
    Insights from the Future for Continual LearningArthur Douillard, Eduardo Valle, Charles Ollion … Matthieu CordCVPR · Sorbonne Université · Universidade Estadual de Campinas (UNICAMP)
    PDF ↗
  22. 2021
    Neural Architecture Search of Deep Priors: Towards Continual Learning without Catastrophic InterferenceMartin Mundt, Iuliia Pliushch, Visvanathan RameshCVPR · Goethe University Frankfurt
    PDF ↗
  23. 2021
    CL-Gym: Full-Featured PyTorch Library for Continual LearningSeyed Iman Mirzadeh, Hassan GhasemzadehCVPR · Washington State University
  24. 2021
    DANICE: Domain adaptation without forgetting in neural image compressionSudeep Katakol, Luis Herranz, Fei Yang, Marta MrakCVPR · University of Michigan · Umbo Computer Vision (United Kingdom) · +1
    PDF ↗
  25. 2021
    Plastic and Stable Gated Classifiers for Continual LearningNicholas I-Hsien Kuo, Mehrtash Harandi, Nicolas Fourrier … Hanna SuominenCVPR · Australian National University · UNSW Sydney · +5
  26. 2021
    A study on the plasticity of neural networksTudor Berariu, Wojciech Marian Czarnecki, Soham De … Claudia ClopatharXiv · Imperial College London
    PDF ↗
  27. 2021
    Continual Model-Based Reinforcement Learning with HypernetworksYizhou Huang, Kevin Xie, Homanga Bharadhwaj, Florian ShkurtiICRA · University of Toronto
    PDF ↗
  28. 2021
    F-SIOL-310: A Robotic Dataset and Benchmark for Few-Shot Incremental Object LearningAli Ayub, Alan R. WagnerICRA · Pennsylvania State University
    PDF ↗
  29. 2021
    Toward Robust and Efficient Online Adaptation for Deep Stereo Depth EstimationMilo Knowles, Valentin Peretroukhin, W. Nicholas Greene, Nicholas RoyICRA · Massachusetts Institute of Technology
  30. 2021
    SID: Incremental Learning for Anchor-Free Object Detection via Selective and Inter-Related DistillationCan Peng, Kun Zhao, Sam Maksoud … Brian C. LovellComputer Vision and Image Understanding · The University of Queensland
    PDF ↗
  31. 2021
    Encoders and Ensembles for Task-Free Continual LearningMurray Shanahan, Christos Kaplanis, Jovana MitrovicarXiv
    PDF ↗
  32. 2021
    Continual World: A Robotic Benchmark For Continual Reinforcement LearningMaciej Wołczyk, Michał Zając, Razvan Pascanu … Piotr MiłośNeurIPS · Jagiellonian University · Google (United States)
    PDF ↗
  33. 2021
    Using Hindsight to Anchor Past Knowledge in Continual LearningArslan Chaudhry, Albert Gordo, Puneet K. Dokania … David López-PazAAAI · University of Oxford · Meta (Israel)
    PDF ↗
  34. 2021
    Online Class-Incremental Continual Learning with Adversarial Shapley ValueDongsub Shim, Zheda Mai, Jihwan Jeong … Jongseong JangAAAI · University of Toronto
  35. 2021
    Few-Shot Class-Incremental Learning via Relation Knowledge DistillationSonglin Dong, Xiaopeng Hong, Xiaoyu Tao … Yihong GongAAAI · Xi'an Jiaotong University
  36. 2021
    Overcoming Catastrophic Forgetting in Graph Neural Networks with Experience ReplayFan Zhou, Chengtai CaoAAAI · University of Electronic Science and Technology of China
  37. 2021
    Overcoming Catastrophic Forgetting in Graph Neural NetworksHuihui Liu, Yiding Yang, Xinchao WangAAAI · Stevens Institute of Technology
    PDF ↗
  38. 2021
    Few-Shot Lifelong LearningPratik Mazumder, Pravendra Singh, Piyush RaiAAAI · Indian Institute of Technology Kanpur
    PDF ↗
  39. 2021
    Continual Learning for Named Entity RecognitionNatawut Monaikul, Giuseppe Castellucci, Simone Filice, Oleg RokhlenkoAAAI · University of Illinois Chicago · Amazon (Germany)
  40. 2021
    Curriculum-Meta Learning for Order-Robust Continual Relation ExtractionTongtong Wu, Xuekai Li, Yuan-Fang Li … Guoqiang XuAAAI · Southeast University · Monash University · +1
    PDF ↗
  41. 2021
    Gradient Regularized Contrastive Learning for Continual Domain AdaptationShixiang Tang, Peng Su, Dapeng Chen, Wanli OuyangAAAI · The University of Sydney · Chinese University of Hong Kong · +1
    PDF ↗
  42. 2021
    Continual Learning by Using Information of Each Class HolisticallyWenpeng Hu, Qi Qin, Mengyu Wang … Bing LiuAAAI · Peking University
  43. 2021
    Generalising without Forgetting for Lifelong Person Re-IdentificationGuile Wu, Shaogang GongAAAI · Queen Mary University of London
  44. 2021
    Lifelong and Continual Learning Dialogue Systems: Learning during ConversationBing Liu, Sahisnu MazumderAAAI · University of Illinois Chicago
  45. 2021
    Gated Linear NetworksJoel Veness, Tor Lattimore, David Budden … Marcus HütterAAAI · Google DeepMind (United Kingdom)
    PDF ↗
  46. 2021
    I3DOL: Incremental 3D Object Learning without Catastrophic ForgettingJiahua Dong, Yang Cong, Gan Sun … Lichen WangAAAI · Shenyang Institute of Automation · University of Chinese Academy of Sciences · +2
    PDF ↗
  47. 2021
    Multi-Domain Multi-Task Rehearsal for Lifelong LearningFan Lyu, Shuai Wang, Wei Feng … Song WangAAAI · Tianjin University · University of South Carolina · +1
    PDF ↗
  48. 2021
    Class-Incremental Instance Segmentation via Multi-Teacher NetworksYanan Gu, Cheng Deng, Kun WeiAAAI · Xidian University
  49. 2021PDF ↗
  50. 2021
    A Continual Learning Framework for Uncertainty-Aware Interactive Image SegmentationErvine Zheng, Qi Yu, Rui Li … Anne R. HaakeAAAI · Rochester Institute of Technology
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.