Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

107 papers of 11,817 · showing 51–100Sort Recent · Most cited
  1. 2022
    Efficient Bayesian Policy Reuse With a Scalable Observation Model in Deep Reinforcement LearningJinmei Liu, Zhi Wang, Chunlin Chen, Daoyi DongTNNLS · Nanjing University · University of Canberra · +1
    PDF ↗
  2. 2022
    Dynamics-Adaptive Continual Reinforcement Learning via Progressive ContextualizationTiantian Zhang, Zichuan Lin, Yuxing Wang … Xiu LiTNNLS · Tencent (China) · Tsinghua University · +1
    PDF ↗
  3. 2023
    Multiagent Continual Coordination via Progressive Task ContextualizationLei Yuan, Lihe Li, Ziqian Zhang … Yang YuTNNLS
    PDF ↗
  4. 2023PDF ↗
  5. 2023
  6. 2021
    Continual Learning of Generative Models With Limited Data: From Wasserstein-1 Barycenter to Adaptive CoalescenceMehmet Dedeoğlu, Sen Lin, Zhaofeng Zhang, Junshan ZhangTNNLS · Arizona State University · The Ohio State University · +1
    PDF ↗
  7. 2023PDF ↗
  8. 2021
    Prototype-Guided Memory Replay for Continual LearningStella Ho, Ming Liu, Lan Du … Yong XiangTNNLS · Deakin University · Monash University · +1
    PDF ↗
  9. 2023PDF ↗
  10. 2023
    Robust and Rotation-Equivariant Contrastive LearningGairui Bai, Wei Xi, Xiaopeng Hong … Songwen ZhaoTNNLS
  11. 2023PDF ↗
  12. 2022
    Power Law in Deep Neural Networks: Sparse Network Generation and Continual Learning With Preferential AttachmentFan Feng, Lu Hou, Qi She … James T. KwokTNNLS · City University of Hong Kong · Hong Kong University of Science and Technology
  13. 2022
    Deep Class-Incremental Learning From Decentralized DataXiaohan Zhang, Songlin Dong, Jinjie Chen … Xiaopeng HongTNNLS · Xi'an Jiaotong University · Huawei Technologies (China) · +1
    PDF ↗
  14. 2022
    Tree Broad Learning System for Small Data ModelingHeng Xia, Jian Tang, Wen Yu, Junfei QiaoTNNLS · Beijing University of Technology · Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional
  15. 2021
    Incremental Cluster Validity Index-Guided Online Learning for Performance and Robustness to Presentation OrderLeonardo Enzo Brito da Silva, Nagasharath Rayapati, Donald C. WunschTNNLS · Missouri University of Science and Technology
    PDF ↗
  16. 2022
    Incremental Embedding Learning With Disentangled Representation TranslationKun Wei, Da Chen, Yuhong Li … Dacheng TaoTNNLS · Xidian University · Alibaba Group (China) · +1
  17. 2022
    BASS: Broad Network Based on Localized Stochastic SensitivityTing Wang, Mingyang Zhang, Jianjun Zhang … C. L. Philip ChenTNNLS · Guangzhou First People's Hospital · South China University of Technology · +2
  18. 2022
    Self-Growing Binary Activation Network: A Novel Deep Learning Model With Dynamic ArchitectureZe-Yang Zhang, Yidong Chen, Changle ZhouTNNLS · Xiamen University
  19. 2021
    Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge DistillationTiantian Zhang, Xueqian Wang, Bin Liang, Bo YuanTNNLS · University Town of Shenzhen · Tsinghua University
    PDF ↗
  20. 2021
    Unsupervised Continual Learning in Streaming EnvironmentsAndri Ashfahani, Mahardhika PratamaTNNLS · Nanyang Technological University · University of South Australia
    PDF ↗
  21. 2020
    Instance Weighted Incremental Evolution Strategies for Reinforcement Learning in Dynamic EnvironmentsZhi Wang, Chunlin Chen, Daoyi DongTNNLS · University of Canberra · UNSW Sydney · +1
    PDF ↗
  22. 2020
    Self-Training for Class-Incremental Semantic SegmentationLu Yu, Xialei Liu, Joost van de WeijerTNNLS · Tianjin University of Technology · Nankai University · +1
    PDF ↗
  23. 2020
    Efficient Architecture Search for Continual LearningQiang Gao, Zhipeng Luo, Diego Klabjan, Fengli ZhangTNNLS · Southwestern University of Finance and Economics · Northwestern University · +1
    PDF ↗
  24. 2022
    KNNENS: A k-Nearest Neighbor Ensemble-Based Method for Incremental Learning Under Data Stream With Emerging New ClassesJianjun Zhang, Ting Wang, Wing W. Y. Ng, Witold PedryczTNNLS · South China University of Technology · Guangzhou First People's Hospital · +2
  25. 2022
    Model Behavior Preserving for Class-Incremental LearningYu Liu, Xiaopeng Hong, Xiaoyu Tao … Yihong GongTNNLS · Xi'an Jiaotong University
  26. 2020
    Triple-Memory Networks: A Brain-Inspired Method for Continual LearningLiyuan Wang, Bo Lei, Qian Li … Yi ZhongTNNLS · Chinese Institute for Brain Research · Center for Life Sciences · +1
    PDF ↗
  27. 2021
    Learning to Classify With Incremental New ClassDa-Wei Zhou, Yang Yang, De-Chuan ZhanTNNLS · Nanjing University · Nanjing University of Science and Technology
  28. 2021
    GopGAN: Gradients Orthogonal Projection Generative Adversarial Network With Continual LearningXiaobin Li, Weiqiang WangTNNLS · University of Chinese Academy of Sciences
  29. 2019
    SpaRCe: Improved Learning of Reservoir Computing Systems Through Sparse RepresentationsLuca Manneschi, Andrew C. Lin, Eleni VasilakiTNNLS · University of Sheffield
    PDF ↗
  30. 2021
    Lifelong Mixture of Variational AutoencodersFei Ye, Adrian G. BorşTNNLS · University of York
    PDF ↗
  31. 2021
    Memory Recall: A Simple Neural Network Training Framework Against Catastrophic ForgettingBaosheng Zhang, Yuchen Guo, Yipeng Li … Qionghai DaiTNNLS · Tsinghua University · Tsinghua–Berkeley Shenzhen Institute
  32. 2021
    Incremental Deep Neural Network Learning Using Classification Confidence ThresholdingJustin Leo, Jugal KalitaTNNLS · University of Colorado Colorado Springs
    PDF ↗
  33. 2021
    Frequency Principle in Broad Learning SystemGuangyong Chen, Min Gan, C. L. Philip Chen … Long ChenTNNLS · Fuzhou University · South China University of Technology · +1
  34. 2020
    Memory-Efficient Class-Incremental Learning for Image ClassificationHanbin Zhao, Hui Wang, Yongjian Fu … Xi LiTNNLS · Zhejiang University of Science and Technology · Shanghai Advanced Research Institute
    PDF ↗
  35. 2021
    Bioinspired Gain-Modulated Recurrent Neural Network for Controlling Musculoskeletal Robot.Shanlin Zhong, Junjie Zhou, Hong QiaoTNNLS · Shandong Institute of Automation · Institute of Automation · +2
  36. 2021
    Face Sketch Synthesis Using Regularized Broad Learning SystemPing Li, Bin Sheng, C. L. Philip ChenTNNLS · Hong Kong Polytechnic University · Shanghai Jiao Tong University · +3
  37. 2021
    A Two-Stream Continual Learning System With Variational Domain-Agnostic Feature ReplayQicheng Lao, Xiang Jiang, Mohammad Havaei, Yoshua BengioTNNLS · West China Medical Center of Sichuan University
  38. 2020
    Beneficial Perturbation Network for Designing General Adaptive Artificial Intelligence SystemsShixian Wen, Amanda Rios, Yunhao Ge, Laurent IttiTNNLS · University of Southern California
    PDF ↗
  39. 2020
    Lifelong Incremental Reinforcement Learning With Online Bayesian InferenceZhi Wang, Chunlin Chen, Daoyi DongTNNLS · Nanjing University · University of Canberra · +1
    PDF ↗
  40. 2019
    Overcoming Long-Term Catastrophic Forgetting Through Adversarial Neural Pruning and Synaptic ConsolidationJian Peng, Bo Tang, Hao Jiang … Haifeng LiTNNLS · Central South University · Mississippi State University · +3
    PDF ↗
  41. 2020
    A Hybrid Recursive Implementation of Broad Learning With Incremental FeaturesDi Liu, Simone Baldi, Wenwu Yu, C. L. Philip ChenTNNLS · Southeast University · Delft University of Technology · +1
  42. 2019
    Representative Task Self-Selection for Flexible Clustered Lifelong LearningGan Sun, Yang Cong, Qianqian Wang … Yun FuTNNLS · Northeastern University · Shenyang Institute of Automation · +3
    PDF ↗
  43. 2019
    Continual Learning Using Bayesian Neural NetworksHonglin Li, Payam Barnaghi, Shirin Enshaeifar, Frieder GanzTNNLS · University of Surrey · UK Dementia Research Institute · +1
    PDF ↗
  44. 2019
    Incremental Concept Learning via Online Generative Memory RecallHuaiyu Li, Weiming Dong, Bao-Gang HuTNNLS · Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence · +2
    PDF ↗
  45. 2019
    Broad Learning System Based on Maximum Correntropy CriterionYunfei Zheng, Badong Chen, Shiyuan Wang, Weiqun WangTNNLS · Xi'an Jiaotong University · Southwest University · +2
    PDF ↗
  46. 2020
    Convolutional Neural Network With Developmental Memory for Continual LearningGyeong-Moon Park, Sahng-Min Yoo, Jong-Hwan KimTNNLS · Electronics and Telecommunications Research Institute · Korea Advanced Institute of Science and Technology
  47. 2020
    IncDet: In Defense of Elastic Weight Consolidation for Incremental Object DetectionLiyang Liu, Zhanghui Kuang, Yimin Chen … Wayne ZhangTNNLS · University Town of Shenzhen · Tsinghua University · +2
  48. 2020
    Lifelong Visual-Tactile Cross-Modal Learning for Robotic Material PerceptionWendong Zheng, Huaping Liu, Fuchun SunTNNLS · Hebei University of Technology · Tsinghua University
  49. 2020
    Continual Multiview Task Learning via Deep Matrix FactorizationGan Sun, Yang Cong, Yulun Zhang … Yun FuTNNLS · Northeastern University · Shenyang Institute of Automation · +2
  50. 2020
    Multiclass Oblique Random Forests With Dual-Incremental Learning CapacityZheng Chai, Chunhui ZhaoTNNLS · State Key Laboratory of Industrial Control Technology
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.