Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

90 papers of 8,653 · showing 51–90Sort Recent · Most cited
  1. 2021
    Prototype-Guided Memory Replay for Continual LearningStella Ho, Ming Liu, Lan Du … Yong XiangTNNLS · Deakin University · Monash University · +1
    PDF ↗
  2. 2023
    InOR-Net: Incremental 3-D Object Recognition Network for Point Cloud RepresentationJiahua Dong, Yang Cong, Gan Sun … Ender KonukoğluTNNLS · Shenyang Institute of Automation · Chinese Academy of Sciences · +4
    PDF ↗
  3. 2023
    Open-Ended Online Learning for Autonomous Visual PerceptionHaibin Yu, Yang Cong, Gan Sun … Jiahua DongTNNLS
  4. 2022
    Power Law in Deep Neural Networks: Sparse Network Generation and Continual Learning With Preferential AttachmentFan Feng, Lu Hou, Qi She … James T. KwokTNNLS · City University of Hong Kong · Hong Kong University of Science and Technology
  5. 2022
    Deep Class-Incremental Learning From Decentralized DataXiaohan Zhang, Songlin Dong, Jinjie Chen … Xiaopeng HongTNNLS · Xi'an Jiaotong University · Huawei Technologies (China) · +1
    PDF ↗
  6. 2022
    Uncertainty Estimation With Neural Processes for Meta-Continual LearningXuesong Wang, Lina Yao, Xianzhi Wang … Sen WangTNNLS · University of Technology Sydney · UNSW Sydney · +4
  7. 2021
    Incremental Cluster Validity Index-Guided Online Learning for Performance and Robustness to Presentation OrderLeonardo Enzo Brito da Silva, Nagasharath Rayapati, Donald C. WunschTNNLS · Missouri University of Science and Technology
    PDF ↗
  8. 2022
    Incremental Embedding Learning With Disentangled Representation TranslationKun Wei, Da Chen, Yuhong Li … Dacheng TaoTNNLS · Xidian University · Alibaba Group (China) · +1
  9. 2022
    Self-Growing Binary Activation Network: A Novel Deep Learning Model With Dynamic ArchitectureZe-Yang Zhang, Yidong Chen, Changle ZhouTNNLS · Xiamen University
  10. 2021
    Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge DistillationTiantian Zhang, Xueqian Wang, Bin Liang, Bo YuanTNNLS · University Town of Shenzhen · Tsinghua University
    PDF ↗
  11. 2021
    Unsupervised Continual Learning in Streaming EnvironmentsAndri Ashfahani, Mahardhika PratamaTNNLS · Nanyang Technological University · University of South Australia
    PDF ↗
  12. 2020
    Instance Weighted Incremental Evolution Strategies for Reinforcement Learning in Dynamic EnvironmentsZhi Wang, Chunlin Chen, Daoyi DongTNNLS · University of Canberra · UNSW Sydney · +1
    PDF ↗
  13. 2020
    Self-Training for Class-Incremental Semantic SegmentationLu Yu, Xialei Liu, Joost van de WeijerTNNLS · Tianjin University of Technology · Nankai University · +1
    PDF ↗
  14. 2020
    Efficient Architecture Search for Continual LearningQiang Gao, Zhipeng Luo, Diego Klabjan, Fengli ZhangTNNLS · Southwestern University of Finance and Economics · Northwestern University · +1
    PDF ↗
  15. 2022
    KNNENS: A k-Nearest Neighbor Ensemble-Based Method for Incremental Learning Under Data Stream With Emerging New ClassesJianjun Zhang, Ting Wang, Wing W. Y. Ng, Witold PedryczTNNLS · South China University of Technology · Guangzhou First People's Hospital · +2
  16. 2022
    Model Behavior Preserving for Class-Incremental LearningYu Liu, Xiaopeng Hong, Xiaoyu Tao … Yihong GongTNNLS · Xi'an Jiaotong University
  17. 2020
    Triple-Memory Networks: A Brain-Inspired Method for Continual LearningLiyuan Wang, Bo Lei, Qian Li … Yi ZhongTNNLS · Chinese Institute for Brain Research · Center for Life Sciences · +1
    PDF ↗
  18. 2021
    Learning to Classify With Incremental New ClassDa-Wei Zhou, Yang Yang, De-Chuan ZhanTNNLS · Nanjing University · Nanjing University of Science and Technology
  19. 2021
    GopGAN: Gradients Orthogonal Projection Generative Adversarial Network With Continual LearningXiaobin Li, Weiqiang WangTNNLS · University of Chinese Academy of Sciences
  20. 2019
    SpaRCe: Improved Learning of Reservoir Computing Systems Through Sparse RepresentationsLuca Manneschi, Andrew C. Lin, Eleni VasilakiTNNLS · University of Sheffield
    PDF ↗
  21. 2021
    Lifelong Mixture of Variational AutoencodersFei Ye, Adrian G. BorşTNNLS · University of York
    PDF ↗
  22. 2021
    Memory Recall: A Simple Neural Network Training Framework Against Catastrophic ForgettingBaosheng Zhang, Yuchen Guo, Yipeng Li … Qionghai DaiTNNLS · Tsinghua University · Tsinghua–Berkeley Shenzhen Institute
  23. 2021
    Incremental Deep Neural Network Learning Using Classification Confidence ThresholdingJustin Leo, Jugal KalitaTNNLS · University of Colorado Colorado Springs
    PDF ↗
  24. 2020
    Memory-Efficient Class-Incremental Learning for Image ClassificationHanbin Zhao, Hui Wang, Yongjian Fu … Xi LiTNNLS · Zhejiang University of Science and Technology · Shanghai Advanced Research Institute
    PDF ↗
  25. 2021
    A Two-Stream Continual Learning System With Variational Domain-Agnostic Feature ReplayQicheng Lao, Xiang Jiang, Mohammad Havaei, Yoshua BengioTNNLS · West China Medical Center of Sichuan University
  26. 2020
    Beneficial Perturbation Network for Designing General Adaptive Artificial Intelligence SystemsShixian Wen, Amanda Rios, Yunhao Ge, Laurent IttiTNNLS · University of Southern California
    PDF ↗
  27. 2020
    Lifelong Incremental Reinforcement Learning With Online Bayesian InferenceZhi Wang, Chunlin Chen, Daoyi DongTNNLS · Nanjing University · University of Canberra · +1
    PDF ↗
  28. 2019
    Overcoming Long-Term Catastrophic Forgetting Through Adversarial Neural Pruning and Synaptic ConsolidationJian Peng, Bo Tang, Hao Jiang … Haifeng LiTNNLS · Central South University · Mississippi State University · +3
    PDF ↗
  29. 2019
    Representative Task Self-Selection for Flexible Clustered Lifelong LearningGan Sun, Yang Cong, Qianqian Wang … Yun FuTNNLS · Northeastern University · Shenyang Institute of Automation · +3
    PDF ↗
  30. 2019
    Continual Learning Using Bayesian Neural NetworksHonglin Li, Payam Barnaghi, Shirin Enshaeifar, Frieder GanzTNNLS · University of Surrey · UK Dementia Research Institute · +1
    PDF ↗
  31. 2019
    Incremental Concept Learning via Online Generative Memory RecallHuaiyu Li, Weiming Dong, Bao-Gang HuTNNLS · Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence · +2
    PDF ↗
  32. 2020
    Convolutional Neural Network With Developmental Memory for Continual LearningGyeong-Moon Park, Sahng-Min Yoo, Jong-Hwan KimTNNLS · Electronics and Telecommunications Research Institute · Korea Advanced Institute of Science and Technology
  33. 2020
    IncDet: In Defense of Elastic Weight Consolidation for Incremental Object DetectionLiyang Liu, Zhanghui Kuang, Yimin Chen … Wayne ZhangTNNLS · University Town of Shenzhen · Tsinghua University · +2
  34. 2020
    Lifelong Visual-Tactile Cross-Modal Learning for Robotic Material PerceptionWendong Zheng, Huaping Liu, Fuchun SunTNNLS · Hebei University of Technology · Tsinghua University
  35. 2020
    Continual Multiview Task Learning via Deep Matrix FactorizationGan Sun, Yang Cong, Yulun Zhang … Yun FuTNNLS · Northeastern University · Shenyang Institute of Automation · +2
  36. 2020
    Multiclass Oblique Random Forests With Dual-Incremental Learning CapacityZheng Chai, Chunhui ZhaoTNNLS · State Key Laboratory of Industrial Control Technology
  37. 2018
    Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed RepresentationsAlexander G. Ororbia, Ankur Mali, C. Lee Giles, Daniel KiferTNNLS · Rochester Institute of Technology · Pennsylvania State University
    PDF ↗
  38. 2019
    Online Topology Learning by a Gaussian Membership-Based Self-Organizing Incremental Neural NetworkHang Yu, Jie Lü, Guangquan ZhangTNNLS · University of Technology Sydney
  39. 2020
    Generative Memory for Lifelong LearningXin Su, Shangqi Guo, Tian Tan, Feng ChenTNNLS · Beijing Advanced Sciences and Innovation Center · Tsinghua University · +1
  40. 2019
    Perception Coordination Network: A Neuro Framework for Multimodal Concept Acquisition and BindingYoulu Xing, Xiaofeng Shi, Furao Shen … Ah‐Hwee TanTNNLS · Anhui University · Nanjing University · +2
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.