Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

442 papers of 8,653 · showing 101–150Sort Recent · Most cited
  1. 2021
    Continual Learning on Noisy Data Streams via Self-Purified ReplayChris Dongjoo Kim, Jinseo Jeong, Sangwoo Moon, Gunhee KimICCV · Seoul National University
    PDF ↗
  2. 2021
    Online Continual Learning For Visual Food ClassificationJiangpeng He, Fengqing ZhuICCV · Purdue University West Lafayette
    PDF ↗
  3. 2021
    Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential ObservationsZike Yan, Yuxin Tian, Xuesong Shi … Hongbin ZhaICCV · King University · Peking University · +1
    PDF ↗
  4. 2021
    Else-Net: Elastic Semantic Network for Continual Action Recognition from Skeleton DataTianjiao Li, Qiuhong Ke, Hossein Rahmani … Jun LiuICCV · Singapore University of Technology and Design · The University of Melbourne · +2
  5. 2021
    Few-Shot and Continual Learning with Attentive Independent MechanismsEugene Lee, Cheng‐Han Huang, Chen‐Yi LeeICCV · National Yang Ming Chiao Tung University
    PDF ↗
  6. 2021
    Continual Learning for Image-Based Camera LocalizationShuzhe Wang, Zakaria Laskar, Iaroslav Melekhov … Juho KannalaICCV · Aalto University · Kaneka (United States)
    PDF ↗
  7. 2021PDF ↗
  8. 2021PDF ↗
  9. 2021
    Improving De-raining Generalization via Neural ReorganizationJie Xiao, Man Zhou, Xueyang Fu … Zheng-Jun ZhaICCV · University of Science and Technology of China
  10. 2021
    FLAR: A Unified Prototype Framework for Few-sample Lifelong Active RecognitionLei Fan, Peixi Xiong, Wei Wei, Ying WuICCV · Northwestern University
  11. 2021
    Incremental Zero-Shot LearningKun Wei, Cheng Deng, Xu Yang, Dacheng TaoIEEE Trans. Cybernetics · Xidian University · Jingdong (China)
  12. 2021
    Deep Continual Learning for Emerging Emotion RecognitionSelvarajah Thuseethan, Sutharshan Rajasegarar, John YearwoodIEEE Trans. Multimedia · Sabaragamuwa University of Sri Lanka · Deakin University
  13. 2021
    Towards a theory of out-of-distribution learningJayanta Dey, Ali Geisa, Ronak Mehta … Joshua T. VogelsteinarXiv
    PDF ↗
  14. 2021
    Formalizing the Generalization-Forgetting Trade-off in Continual LearningKrishnan Raghavan, Prasanna BalaprakashNeurIPS · Argonne National Laboratory
    PDF ↗
  15. 2021
    Coffee With a Hint of Data: Towards Using Data-Driven Approaches in Personalised Long-Term InteractionsBahar Irfan, Mehdi Hellou, Tony BelpaemeFrontiers · University of Plymouth · Ghent University
  16. 2021
    Behavior Self-Organization Supports Task Inference for Continual Robot LearningMuhammad Burhan Hafez, Stefan WermterIROS · Universität Hamburg · Hamburg University of Technology
    PDF ↗
  17. 2021
    Towards Generalized and Incremental Few-Shot Object DetectionYiting Li, Haiyue Zhu, Jun Ma … Tong Heng LeearXiv
    PDF ↗
  18. 2021
    A dynamic routing CapsNet based on increment prototype clustering for overcoming catastrophic forgettingMeng Wang, Zhengbing Guo, Huafeng LiIET Computer Vision · Kunming University of Science and Technology · Kunming University · +1
    PDF ↗
  19. 2021
    Continuous Multi-View Human Action RecognitionQiang Wang, Gan Sun, Jiahua Dong … Zhengming DingIEEE TCSVT · Xidian University · Shenyang University · +3
  20. 2021
    Hierarchical Lifelong Machine Learning With “Watchdog”Gan Sun, Yang Cong, Changjun Gu … Haibin YuIEEE Transactions · Shenyang Institute of Automation · Chinese Academy of Sciences · +2
  21. 2021
    S2OSC: A Holistic Semi-Supervised Approach for Open Set ClassificationYang Yang, Hongchen Wei, Zhenqiang Sun … Jian YangACM Transactions · Nanjing University of Science and Technology · Nanjing Normal University · +3
    PDF ↗
  22. 2021PDF ↗
  23. 2021
    Statistical Mechanical Analysis of Catastrophic Forgetting in Continual Learning with Teacher and Student NetworksHaruka Asanuma, Shiro Takagi, Yoshihiro Nagano … Masato OkadaJournal of the Physical Society of Japan · The University of Tokyo · University of Tsukuba · +1
    PDF ↗
  24. 2021
    Learning offline: memory replay in biological and artificial reinforcement learningEmma L. Roscow, Raymond Chua, Rui Ponte Costa … Nathan F. LeporaTrends in Neurosciences · Centre de Recerca Matemàtica · McGill University · +2
    PDF ↗
  25. 2021
    Federated Reconnaissance: Efficient, Distributed, Class-Incremental LearningSean M. Hendryx, Dharma Kc, Bradley Walls, Clayton T. MorrisonarXiv · University of Arizona
    PDF ↗
  26. 2021
    Memory-Free Generative Replay For Class-Incremental LearningXiaomeng Xin, Yiran Zhong, Yunzhong Hou … Liang ZhengarXiv
    PDF ↗
  27. 2021
    Replay in Deep Learning: Current Approaches and Missing Biological ElementsTyler L. Hayes, Giri P. Krishnan, Maxim Bazhenov … Christopher KananNeural Computation · Rochester Institute of Technology · University of California San Diego · +5
    PDF ↗
  28. 2021
    Task-Agnostic Continual Learning Using Online Variational Bayes With Fixed-Point UpdatesChen Zeno, Itay Golan, Elad Hoffer, Daniel SoudryNeural Computation · Technion – Israel Institute of Technology · Itamar Medical (Israel)
    PDF ↗
  29. 2021
    FILDNE: A Framework for Incremental Learning of Dynamic Networks EmbeddingsPiotr Bielak, Kamil Tagowski, Maciej Falkiewicz … Nitesh V. ChawlaKnowledge-Based Systems · Wrocław University of Science and Technology · AGH University of Krakow · +1
    PDF ↗
  30. 2021
    MFS: A Brain-Inspired Memory Formation System for GANYifan Chang, Yifan Wang, Jian Peng … Wenbo LiIEEE Transactions · University of Science and Technology of China · Anhui University · +3
  31. 2021PDF ↗
  32. 2021
    SynthASR: Unlocking Synthetic Data for Speech RecognitionAmin Fazel, Wei Yang, Yulan Liu … Jasha DroppoInterspeech · Samsung (South Korea) · Amazon (United States) · +1
    PDF ↗
  33. 2021
    Continual Learning for Fake Audio DetectionHaoxin Ma, Jiangyan Yi, Jianhua Tao … Chenglong WangInterspeech · Chinese Academy of Sciences · Center for Excellence in Education · +1
    PDF ↗
  34. 2021
    Towards Lifelong Learning of End-to-end ASRHeng-Jui Chang, Hung-yi Lee, Lin-shan LeeInterspeech · National Taiwan University
    PDF ↗
  35. 2021
    FastICARL: Fast Incremental Classifier and Representation Learning with Efficient Budget Allocation in Audio Sensing ApplicationsYoung D. Kwon, Jagmohan Chauhan, Cecilia MascoloInterspeech · University of Cambridge · University of Southampton
    PDF ↗
  36. 2021
    Continual learning under domain transfer with sparse synaptic burstingShawn Beaulieu, Jeff Clune, Nick CheneyarXiv · University of Vermont
    PDF ↗
  37. 2021
    Semi-Supervised Few-Shot Class-Incremental LearningYawen Cui, Wuti Xiong, Mohammad Tavakolian, Li LiuICIP · University of Oulu · National University of Defense Technology
  38. 2021
    Class Incremental Learning for Video Action ClassificationJiawei Ma, Xiaoyu Tao, Jianxing Ma … Yihong GongICIP · Xi'an Jiaotong University
  39. 2021
    Task-Agnostic Continual Learning Using Base-Child ClassifiersPranshu Ranjan Singh, Saisubramaniam Gopalakrishnan, Qiao ZhongZheng … ArulMurugan AmbikapathiICIP · Agency for Science, Technology and Research · Institute for Infocomm Research · +1
  40. 2021
    Optimal Developmental Learning for Multisensory and Multi-Teaching ModalitiesJulia Knoll, Jacob Honer, Samuel Church, Juyang WengIEEE International Conference on Development and Learning… · Michigan State University
  41. 2021
    A Brain-Inspired Homeostatic Neuron Based on Phase-Change Memories for Efficient Neuromorphic ComputingIrene Muñoz-Martín, S. Bianchi, Shahin Hashemkhani … Daniele IelminiFrontiers · Politecnico di Milano
  42. 2021
    A good body is all you need: avoiding catastrophic interference via agent architecture searchJoshua Powers, Ryan Grindle, L. Frati, Josh BongardarXiv · University of Vermont
    PDF ↗
  43. 2021
    Stable continual learning through structured multiscale plasticity manifoldsPoonam Mishra, Rishikesh NarayananCurrent Opinion in Neurobiology · Indian Institute of Science Bangalore
  44. 2021
    Continual semi-supervised learning through contrastive interpolation consistencyMatteo Boschini, Pietro Buzzega, Lorenzo Bonicelli … Simone CalderaraPattern Recognition Letters · University of Modena and Reggio Emilia
    PDF ↗
  45. 2021
    Continual Backprop: Stochastic Gradient Descent with Persistent RandomnessShibhansh Dohare, Richard S. Sutton, A. Rupam MahmoodarXiv · University of Alberta
    PDF ↗
  46. 2021
    Schematic Memory Persistence and Transience for Efficient and Robust Continual LearningYuyang Gao, Giorgio A. Ascoli, Liang ZhaoNeural Networks · Emory University · George Mason University · +2
    PDF ↗
  47. 2021
    Continual Multi-Agent Interaction Behavior Prediction With Conditional Generative MemoryHengbo Ma, Yaofeng Sun, Jiachen Li … Chiho ChoiRA-L · Honda (United States) · University of California, Berkeley · +1
  48. 2021
    MeLL: Large-scale Extensible User Intent Classification for Dialogue Systems with Meta Lifelong LearningChengyu Wang, Haojie Pan, Yuan Liu … Deng CaiKDD · Alibaba Group (China) · Zhejiang University
  49. 2021
    Lifelong Intent Detection via Multi-Strategy RebalancingQingbin Liu, Xiaoyan Yu, Shizhu He … Jun ZhaoarXiv
    PDF ↗
  50. 2021
    Progressive Convolutional Neural Network for Incremental LearningZahid Ali Siddiqui, Unsang ParkElectronics · Sogang University
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.