Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

828 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2022
    Continual learning approaches for anomaly detectionDavide Dalle Pezze, Eugenia Anello, Chiara Masiero, Gian Antonio SustoEvolving Systems · University of Padua · PENTA Foundation
    PDF ↗
  2. 2022
    Unveiling the Tapestry: The Interplay of Generalization and Forgetting in Continual LearningZenglin Shi, Jie Jing, Ying Sun … Mengmi ZhangTNNLS · Nanyang Technological University · Agency for Science, Technology and Research
    PDF ↗
  3. 2022
    Exemplar-Free Continual Learning of Vision Transformers via Gated Class-Attention and Cascaded Feature Drift CompensationMarco Cotogni, Fei Yang, Claudio Cusano … Joost van de WeijerIJCV · University of Pavia · BGI Group (China) · +4
    PDF ↗
  4. 2022
    CL-Cross VQA: A Continual Learning Benchmark for Cross-Domain Visual Question AnsweringYao Zhang, Haokun Chen, Ahmed Frikha … Volker TrespWACV · LMU Klinikum · Ludwig-Maximilians-Universität München · +1
    PDF ↗
  5. 2022
    MEIL-NeRF: Memory-Efficient Incremental Learning of Neural Radiance FieldsJaeyoung Chung, K. Lee, Sungyong Baik, Kyoung Mu LeeIEEE Access · Seoul National University · Hanyang University
    PDF ↗
  6. 2022
    Exploring the Intersection Between Neural Architecture Search and Continual LearningMohamed Shahawy, Elhadj Benkhelifa, David WhiteTNNLS · University of Staffordshire
    PDF ↗
  7. 2022
    Learning to Predict Gradients for Semi-Supervised Continual LearningYan Luo, Yongkang Wong, Mohan Kankanhalli, Qi ZhaoTNNLS · University of Minnesota · Harvard University · +2
    PDF ↗
  8. 2022
    Continual Learning via Sequential Function-Space Variational InferenceTim G. J. Rudner, Freddie Bickford Smith, Qixuan Feng … Yarin GalICML
    PDF ↗
  9. 2022
    AdaptCL: Adaptive Continual Learning for Tackling Heterogeneity in Sequential DatasetsYuqing Zhao, Divya Saxena, Jiannong CaoTNNLS · Hong Kong Polytechnic University
    PDF ↗
  10. 2022
    Exact learning dynamics of deep linear networks with prior knowledgeClémentine Dominé, Lukas Braun, James E. Fitzgerald, Andrew SaxeNeurIPS · Gatsby Computational Neuroscience Unit · University College London · +4
  11. 2022
    Probabilistic Bilevel Coreset SelectionXiaofang Zhou, Renjie Pi, Weizhong Zhang … Tong ZhangICML
    PDF ↗
  12. 2022
    Self-Activating Neural Ensembles for Continual Reinforcement LearningSam Powers, Xing, Eliot, Gupta, AbhinavCoLLAs · Carnegie Mellon University · Meta (Israel)
    PDF ↗
  13. 2022
    Domain Expansion for End-to-End Speech Recognition: Applications for Accent/Dialect SpeechShahram Ghorbani, John H. L. HansenIEEE/ACM Transactions on Audio Speech and Language Proces… · The University of Texas at Dallas
  14. 2022
    Communication-efficient federated continual learning for distributed learning system with Non-IID dataZhao Zhang, Yong Zhang, Da Guo … Xiaolin ZhuInformation Sciences · Beijing University of Posts and Telecommunications
  15. 2022
  16. 2022
    Complementary Calibration: Boosting General Continual Learning With Collaborative Distillation and Self-SupervisionZhong Ji, Jin Li, Qiang Wang, Zhongfei ZhangTIP · Tianjin University · Binghamton University
    PDF ↗
  17. 2022
    Hierarchically structured task-agnostic continual learningHeinke Hihn, Daniel BraunMachine Learning · Universität Ulm
    PDF ↗
  18. 2022
    Saliency-Augmented Memory Completion for Continual LearningGuangji Bai, Ling Chen, Yuyang Gao, Liang ZhaoSDM
    PDF ↗
  19. 2022
    High-Quality-High-Quantity Semantic Distillation for Incremental Object DetectionMengxue Kang, Jinpeng Zhang, Xiashuang Wang, Xuhui Huang2022 5th International Conference on Algorithms, Computin… · China Aerospace Science and Industry Corporation (China)
  20. 2022
    Towards Continual Reinforcement Learning: A Review and PerspectivesKhimya Khetarpal, Matthew Riemer, Irina Rish, Doina PrecupJournal of Artificial Intelligence Research · Google DeepMind (United Kingdom) · McGill University · +2
    PDF ↗
  21. 2022
    Neural Manifold Modulated Continual Reinforcement Learning for Musculoskeletal RobotsJiahao Chen, Ziyu Chen, Chaojing Yao, Hong QiaoIEEE TCDS · Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence · +2
  22. 2022
    Memory-Based Method using Prototype Augmentation for Continual Relation ExtractionQuynh-Trang Pham Thi, Anh-Cuong Pham, Ngoc-Huyen Ngo, Duc-Trong LeRIVF International Conference on Computing and Communicat…
  23. 2022
    Differentially Private Federated Continual Learning with Heterogeneous Cohort PrivacyAjesh Koyatan Chathoth, Clark P Necciai, Abhyuday Jagannatha, Stephen LeeIEEE International Conference on Big Data (Big Data) · University of Pittsburgh · University of Massachusetts Amherst
  24. 2022
    Scalable Learning with Incremental Probabilistic PCABoshi Wang, Adrian BarbuIEEE International Conference on Big Data (Big Data) · Florida State University
  25. 2022
    Sleep-like unsupervised replay reduces catastrophic forgetting in artificial neural networksTimothy Tadros, Giri P. Krishnan, Ramyaa Ramyaa, Maxim BazhenovNature Communications · University of California San Diego · New Mexico Institute of Mining and Technology
  26. 2022
    ISM-Net: Mining incremental semantics for class incremental learningZihuan Qiu, Linfeng Xu, Zhichuan Wang … Hongliang LiNeurocomputing · University of Electronic Science and Technology of China
  27. 2022
    A Novel Machine Learning Method for Delayed LabelsHaoran Gao, Zhijun DingIEEE International Conference on Networking, Sensing and… · Tongji University
  28. 2022
    DIODE: Dilatable Incremental Object DetectionCan Peng, Kun Zhao, Sam Maksoud … Brian C. LovellPattern Recognition · The University of Queensland
    PDF ↗
  29. 2022PDF ↗
  30. 2022
    Overcoming Catastrophic Forgetting for Semantic Segmentation Via Incremental LearningYizhuo Yang, Shenghai Yuan, Lihua XieInternational Conference on Control, Automation, Robotics… · Nanyang Technological University
  31. 2022
    Continual Learning of Vacuum Grasps from Grasp Outcome for Unsupervised Domain AdaptionMaximilian Gilles, Vinzenz RauInternational Conference on Robotics, Automation and Arti… · Karlsruhe Institute of Technology · FZI Research Center for Information Technology
  32. 2022
    G-MAP: General Memory-Augmented Pre-trained Language Model for Domain TasksZhongwei Wan, Yichun Yin, Wei Zhang … Liu, QunEMNLP
    PDF ↗
  33. 2022
    Open World DETR: Transformer based Open World Object DetectionNa Dong, Yongqiang Zhang, Mingli Ding, Gim Hee LeearXiv
    PDF ↗
  34. 2022
    Continual Recognition with Adaptive Memory UpdateXuanrong Yao, Xin Wang, Yue Liu, Wenwu ZhuACM Transactions · Tsinghua University
  35. 2022
    Evidential Deep Learning for Class-Incremental Semantic SegmentationKarl Holmquist, Lena M. Klasen, Michael FelsbergScandinavian Conference on Image Analysis
    PDF ↗
  36. 2022PDF ↗
  37. 2022
    Optimal Adaptive Output Regulation of Uncertain Nonlinear Discrete-time Systems using Lifelong Concurrent LearningRohollah Moghadam, Behzad Farzanegan, S. Jagannathan, Ponnammal NatarajanIEEE 61st Conference on Decision and Control (CDC) · California State University, Sacramento · Missouri University of Science and Technology · +1
  38. 2022
    Three types of incremental learningGido M. van de Ven, Tinne Tuytelaars, Andreas S. ToliasNature Machine Intelligence · Baylor College of Medicine · University of Cambridge · +2
  39. 2022
    DA-CIL: Towards Domain Adaptive Class-Incremental 3D Object DetectionZiyuan Zhao, Mingxi Xu, Peisheng Qian … Richard ChangBMVC
    PDF ↗
  40. 2022
    A Hybrid Active-Passive Approach to Imbalanced Nonstationary Data Stream ClassificationKleanthis Malialis, Manuel Roveri, Cesare Alippi … Marios M. PolycarpouIEEE Symposium Series on Computational Intelligence (SSCI) · University of Cyprus · Politecnico di Milano
    PDF ↗
  41. 2022
    EXPANSE: A Continual and Progressive Learning System for Deep Transfer LearningMohammadreza Iman, John A. Miller, Khaled Rasheed … Hamid R. ArabniaInternational Conference on Computational Science and Com… · University of Georgia · Franklin College
  42. 2022
    Contrastive R-CNN for Incremental Learning in Object DetectionPeisheng Qian, Kai Zheng, Cen Chen … Hui Li TanIEEE Smartworld, Ubiquitous Intelligence & Computing,… · Agency for Science, Technology and Research · Institute for Infocomm Research · +2
  43. 2022
    The incremental learning algorithm for compartmental spiking neuron modelE A Eremenko, Anton Korsakov, Aleksandr BakhshievJournal of Physics Conference Series · Russian State Scientific Center for Robotics and Technical Cybernetics · Peter the Great St. Petersburg Polytechnic University
  44. 2022
    FIG-LP: Feature-Inverse-Graph based Link Prediction in Graph StreamXu Zhang, Xiao-Qiang Xiao, Guowei Li … Jiantong SongIEEE Smartworld, Ubiquitous Intelligence & Computing,… · National University of Defense Technology · Changsha University
  45. 2022
    ICFD: An Incremental Learning Method Based on Data Feature DistributionYunzhe Zhu, Yusong Tan, Xiaoling Li … Xueqin NingIEEE Smartworld, Ubiquitous Intelligence & Computing,… · National University of Defense Technology
  46. 2022
  47. 2022PDF ↗
  48. 2022
    Continual Learning with Distributed Optimization: Does CoCoA Forget Under Task Repetition?Martin Hellkvist, Ayça Özçelikkale, Anders ÅhlénEuropean Signal Processing Conference
    PDF ↗
  49. 2022
    The geometry of representational drift in natural and artificial neural networksKyle Aitken, Marina Garrett, Shawn R. Olsen, Ştefan MihalaşPLOS · Allen Institute
  50. 2022
    Progressive Learning without ForgettingTao Feng, Hangjie Yuan, Mang Wang … Jianzhou ZhangarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.