Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

64 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2022
    TAME: Task Agnostic Continual Learning using Multiple ExpertsHaoran Zhu, Maryam Majzoubi, Arihant Jain, Anna ChoromanskaCVPR · New York University · Google (United States)
    PDF ↗
  2. 2022
    Task-Adaptive Saliency Guidance for Exemplar-Free Class Incremental LearningXialei Liu, Jiang-Tian Zhai, Andrew D. Bagdanov … Ming‐Ming ChengCVPR · Nankai University · University of Florence · +1
    PDF ↗
  3. 2022
    CODA-Prompt: COntinual Decomposed Attention-Based Prompting for Rehearsal-Free Continual LearningJames Seale Smith, Leonid Karlinsky, Vyshnavi Gutta … Zsolt KiraCVPR · Georgia Institute of Technology · IBM (United States) · +1
    PDF ↗
  4. 2022
    A Closer Look at Rehearsal-Free Continual Learning *James Seale Smith, Junjiao Tian, Shaunak Halbe … Zsolt KiraCVPR · Georgia Institute of Technology · Samsung (United States) · +1
    PDF ↗
  5. 2022
    Re-basin via implicit Sinkhorn differentiationFidel A. Guerrero Peña, Heitor R. Medeiros, Thomas Dubail … Marco PedersoliCVPR · École de Technologie Supérieure
    PDF ↗
  6. 2022
    PIVOT: Prompting for Video Continual LearningAndrés Villa, Juan León Alcázar, Motasem Alfarra … Bernard GhanemCVPR · Pontificia Universidad Católica de Chile · King Abdullah University of Science and Technology · +2
    PDF ↗
  7. 2022
    CoMFormer: Continual Learning in Semantic and Panoptic SegmentationFabio Cermelli, Matthieu Cord, Arthur DouillardCVPR · Politecnico di Torino · Italian Institute of Technology · +2
    PDF ↗
  8. 2022
    SCALE: Online Self-Supervised Lifelong Learning without Prior KnowledgeXiaofan Yu, Yunhui Guo, Sicun Gao, Tajana RosingCVPR · University of California San Diego
    PDF ↗
  9. 2022
    Rebalancing Batch Normalization for Exemplar-Based Class-Incremental LearningSungmin Cha, Sungjun Cho, Dasol Hwang … Taesup MoonCVPR · Seoul National University · University of Illinois Chicago
    PDF ↗
  10. 2022
    D3Former: Debiased Dual Distilled Transformer for Incremental LearningAbdelrahman Mohamed, Rushali Grandhe, K. J. Joseph … Fahad Shahbaz KhanCVPR · Mohamed bin Zayed University of Artificial Intelligence · Adobe Systems (United States) · +1
    PDF ↗
  11. 2022PDF ↗
  12. 2022
    Continual Test-Time Domain AdaptationQin Wang, Olga Fink, Luc Van Gool, Dengxin DaiCVPR · ETH Zurich · École Polytechnique Fédérale de Lausanne · +1
    PDF ↗
  13. 2022
    Learn from Others and Be Yourself in Heterogeneous Federated LearningWenke Huang, Mang Ye, Bo DuCVPR · National Institute of Japanese Literature · Wuhan University
  14. 2022
    Federated Class-Incremental LearningJiahua Dong, Lixu Wang, Zhen Fang … Qi ZhuCVPR · Shenyang Institute of Automation · Chinese Academy of Sciences · +3
    PDF ↗
  15. 2022
    Forward Compatible Few-Shot Class-Incremental LearningDa-Wei Zhou, Fuyun Wang, Han-Jia Ye … De‐Chuan ZhanCVPR · Nanjing University
    PDF ↗
  16. 2022
    Class-Incremental Learning by Knowledge Distillation with Adaptive Feature ConsolidationMinsoo Kang, Jaeyoo Park, Bohyung HanCVPR · Seoul National University
    PDF ↗
  17. 2022
    Constrained Few-shot Class-incremental LearningMichael Hersche, Geethan Karunaratne, Giovanni Cherubini … Abbas RahimiCVPR · ETH Zurich · IBM Research - Zurich
    PDF ↗
  18. 2022
    Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental LearningKai Zhu, Wei Zhai, Yang Cao … Zheng-Jun ZhaCVPR · University of Science and Technology of China · University of Rochester
    PDF ↗
  19. 2022
    MetaFSCIL: A Meta-Learning Approach for Few-Shot Class Incremental LearningZhixiang Chi, Li Gu, Huan Liu … Jin TangCVPR · Huawei Technologies (Sweden) · McMaster University · +1
  20. 2022
    Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response DistillationTao Feng, Mang Wang, Hangjie YuanCVPR · Alibaba Group (United States) · Zhejiang University
    PDF ↗
  21. 2022
    Representation Compensation Networks for Continual Semantic SegmentationChang–Bin Zhang, Jia-wen Xiao, Xialei Liu … Ming‐Ming ChengCVPR · Nankai University · Hong Kong University of Science and Technology
    PDF ↗
  22. 2022
  23. 2022
    Probing Representation Forgetting in Supervised and Unsupervised Continual LearningMohammadReza Davari, Nader Asadi, Sudhir P. Mudur … Eugene BelilovskyCVPR · Concordia University · Toyota Motor Corporation (Switzerland)
    PDF ↗
  24. 2022
    Continual Learning with Lifelong Vision TransformerZhen Wang, Liu Liu, Yiqun Duan … Dacheng TaoCVPR · The University of Sydney · University of Technology Sydney · +1
  25. 2022
    Towards Open-Set Object Detection and DiscoveryJiyang Zheng, Weihao Li, Jie Hong … Nick BarnesCVPR · Australian National University · Commonwealth Scientific and Industrial Research Organisation · +1
    PDF ↗
  26. 2022
    Class-Incremental Learning with Strong Pre-trained ModelsTz-Ying Wu, Swaminathan Gurumurthy, Zhizhong Li … Stefano SoattoCVPR · UC San Diego Health System
    PDF ↗
  27. 2022
    Class Similarity Weighted Knowledge Distillation for Continual Semantic SegmentationVu Minh Hieu Phan, The-Anh Ta, Son Lam Phung … Abdesselam BouzerdoumCVPR · University of Wollongong · FPT University · +2
  28. 2022
    Task Adaptive Parameter Sharing for Multi-Task LearningMatthew Wallingford, Hao Li, Alessandro Achille … Stefano SoattoCVPR · University of Washington
    PDF ↗
  29. 2022
    Meta-attention for ViT-backed Continual LearningMengqi Xue, Haofei Zhang, Jie Song, Mingli SongCVPR · Zhejiang University
    PDF ↗
  30. 2022
    Online Continual Learning on a Contaminated Data Stream with Blurry Task BoundariesJihwan Bang, Hyunseo Koh, Seulki Park … Jonghyun ChoiCVPR · NAVER Cloud (South Korea) · Naver (South Korea) · +2
    PDF ↗
  31. 2022
    Energy-based Latent Aligner for Incremental LearningK J Joseph, Salman Khan, Fahad Shahbaz Khan … Vineeth N BalasubramanianCVPR · Indian Institute of Technology Hyderabad · Zayed University · +3
    PDF ↗
  32. 2022
    Learning Bayesian Sparse Networks with Full Experience Replay for Continual LearningQingsen Yan, Dong Gong, Yuhang Liu … Qinfeng ShiCVPR · Australian Centre for Robotic Vision · The University of Adelaide · +1
    PDF ↗
  33. 2022PDF ↗
  34. 2022
    Bring Evanescent Representations to Life in Lifelong Class Incremental LearningMarco Toldo, Mete ÖzayCVPR · University of Padua · Samsung (United Kingdom)
  35. 2022
    General Incremental Learning with Domain-aware Categorical RepresentationsJiangwei Xie, Shipeng Yan, Xuming HeCVPR · ShanghaiTech University · Shanghai Institute of Microsystem and Information Technology · +1
    PDF ↗
  36. 2022
    vCLIMB: A Novel Video Class Incremental Learning BenchmarkAndrés Villa, Kumail Alhamoud, Víctor Escorcia … Bernard GhanemCVPR · Pontificia Universidad Católica de Chile · King Abdullah University of Science and Technology · +2
    PDF ↗
  37. 2022
    Continual Object Detection via Prototypical Task Correlation Guided Gating MechanismBinbin Yang, Xinchi Deng, Shi Han … Xiaodan LiangCVPR · Sun Yat-sen University · Hong Kong University of Science and Technology · +1
    PDF ↗
  38. 2022
    On Generalizing Beyond Domains in Cross-Domain Continual LearningChristian Simon, Masoud Faraki, Yi–Hsuan Tsai … Manmohan ChandrakerCVPR · Australian National University · Australian Regenerative Medicine Institute · +5
    PDF ↗
  39. 2022
    Modeling Missing Annotations for Incremental Learning in Object DetectionFabio Cermelli, Antonino Geraci, Dario Fontanel, Barbara CaputoCVPR · Politecnico di Torino · Italian Institute of Technology
    PDF ↗
  40. 2022
    Towards Exemplar-Free Continual Learning in Vision Transformers: an Account of Attention, Functional and Weight RegularizationFrancesco Pelosin, Saurav Jha, Andrea Torsello … Joost van de WeijerCVPR · Ca' Foscari University of Venice · UNSW Sydney · +2
    PDF ↗
  41. 2022
    Few-Shot Class Incremental Learning Leveraging Self-Supervised FeaturesTouqeer Ahmad, Akshay Raj Dhamija, Steve Cruz … Terrance E. BoultCVPR · University of Colorado Colorado Springs
  42. 2022
    Learning to Imagine: Diversify Memory for Incremental Learning using Unlabeled DataYu-Ming Tang, Yi-Xing Peng, Wei‐Shi ZhengCVPR · Ministry of Education of the People's Republic of China · Sun Yat-sen University · +1
    PDF ↗
  43. 2022
    Continual Learning for Visual Search with Backward Consistent Feature EmbeddingTimmy S. T. Wan, Jun-Cheng Chen, Tzer-Yi Wu, Chu-Song ChenCVPR · National Taiwan University · Academia Sinica · +1
    PDF ↗
  44. 2022
    CFA: Constraint-based Finetuning Approach for Generalized Few-Shot Object DetectionKarim Guirguis, Ahmed Hendawy, George Eskandar … Jürgen BeyererCVPR · Robert Bosch (Taiwan) · University of Stuttgart · +2
    PDF ↗
  45. 2022
    Doodle It Yourself: Class Incremental Learning by Drawing a Few SketchesAyan Kumar Bhunia, Viswanatha Reddy Gajjala, Subhadeep Koley … Yi-Zhe SongCVPR · University of Surrey · IFlyTek (China)
    PDF ↗
  46. 2022
    Continual Learning Based on OOD Detection and Task MaskingGyuhak Kim, Sepideh Esmaeilpour, Changnan Xiao, Bing LiuCVPR · University of Illinois Chicago
    PDF ↗
  47. 2022
    Continual Learning with Transformers for Image ClassificationBeyza Ermiş, Giovanni Zappella, Martin Wistuba … Cédric ArchambeauCVPR
    PDF ↗
  48. 2022
    Multi-Head Distillation for Continual Unsupervised Domain Adaptation in Semantic SegmentationAntoine Saporta, Arthur Douillard, Tuan-Hung Vu … Matthieu CordCVPR · Valeo (France) · Sorbonne Université
    PDF ↗
  49. 2022
    CNLL: A Semi-supervised Approach For Continual Noisy Label LearningNazmul Karim, Umar Khalid, Ashkan Esmaeili, Nazanin RahnavardCVPR · University of Central Florida
    PDF ↗
  50. 2022
    Learning to Learn and Remember Super Long Multi-Domain Task SequenceZhenyi Wang, Li Shen, Tiehang Duan … Mingchen GaoCVPR · University at Buffalo, State University of New York · Jingdong (China) · +1
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.