Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

48 papers of 11,817Sort Recent · Most cited
  1. 2022
    Dynamics-Adaptive Continual Reinforcement Learning via Progressive ContextualizationTiantian Zhang, Zichuan Lin, Yuxing Wang … Xiu LiTNNLS · Tencent (China) · Tsinghua University · +1
    PDF ↗
  2. 2022
    Continual Recognition with Adaptive Memory UpdateXuanrong Yao, Xin Wang, Yue Liu, Wenwu ZhuACM Transactions · Tsinghua University
  3. 2022
    Endowing Spiking Neural Networks with Homeostatic Adaptivity for APS-DVS Bimodal ScenariosMingkun Xu, Faqiang Liu, Jing PeiINTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · Tsinghua University
  4. 2022
    A framework for the general design and computation of hybrid neural networksRong Zhao, Zheyu Yang, Hao Zheng … Luping ShiNature Communications · Chinese Institute for Brain Research · Tsinghua University · +1
  5. 2022
    Continual Predictive Learning from VideosGeng Chen, Wendong Zhang, Lu Han … Xiaokang YangCVPR · Shanghai Jiao Tong University · Tsinghua University
    PDF ↗
  6. 2022
    Mixed‐Precision Continual Learning Based on Computational Resistance Random Access MemoryYi Li, Woyu Zhang, Xiaoxin Xu … Dashan ShangAdvanced Intelligent Systems · Chinese Academy of Sciences · Institute of Microelectronics · +3
  7. 2022
    EPicker is an exemplar-based continual learning approach for knowledge accumulation in cryoEM particle pickingXinyu Zhang, Tian-Fang Zhao, Jiansheng Chen … Xueming LiNature Communications · Tsinghua University · University of Science and Technology Beijing · +2
  8. 2021
    Quantum Continual Learning Overcoming Catastrophic ForgettingWenjie Jiang, Zhide Lu, Dong-Ling DengChinese Physics Letters · Tsinghua University · ShangHai JiAi Genetics & IVF Institute
    PDF ↗
  9. 2022
    Energy Alignment for Bias Rectification in Class Incremental LearningBowen Zhao, Chen Chen, Xi Xiao … Shu‐Tao XiaICASSP · Tsinghua University · Peng Cheng Laboratory
  10. 2021
    Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge DistillationTiantian Zhang, Xueqian Wang, Bin Liang, Bo YuanTNNLS · University Town of Shenzhen · Tsinghua University
    PDF ↗
  11. 2022
    Graph Learning on Millions of Data in Seconds: Label Propagation Acceleration on Graph Using Data DistributionYubo Zhang, Shuyi Ji, Changqing Zou … Yue GaoTPAMI · Tsinghua University · Huawei Technologies (Canada) · +1
  12. 2022
    An Efficient Kriging-based Constrained Multi-objective Evolutionary Algorithm for Analog Circuit Synthesis via Self-adaptive Incremental LearningSen Yin, Wenfei Hu, Wenyuan Zhang … Yan WangAsia and South Pacific Design Automation Conference (ASP-… · Tsinghua University
  13. 2020
    Brain-inspired global-local learning incorporated with neuromorphic computingYujie Wu, Rong Zhao, Jun Zhu … Luping ShiNature Communications · Tsinghua University · Chinese Institute for Brain Research · +1
    PDF ↗
  14. 2021
    AFEC: Active Forgetting of Negative Transfer in Continual LearningLiyuan Wang, Ming‐Tian Zhang, Zhongfan Jia … Yi ZhongNeurIPS · Tsinghua University · University College London
    PDF ↗
  15. 2020
    Triple-Memory Networks: A Brain-Inspired Method for Continual LearningLiyuan Wang, Bo Lei, Qian Li … Yi ZhongTNNLS · Chinese Institute for Brain Research · Center for Life Sciences · +1
    PDF ↗
  16. 2021
    Memory Recall: A Simple Neural Network Training Framework Against Catastrophic ForgettingBaosheng Zhang, Yuchen Guo, Yipeng Li … Qionghai DaiTNNLS · Tsinghua University · Tsinghua–Berkeley Shenzhen Institute
  17. 2021
    ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual LearningLiyuan Wang, Kuo Yang, Chongxuan Li … Jun ZhuCVPR · Tsinghua University · Huawei Technologies (Sweden)
    PDF ↗
  18. 2020
    Monitoring multimode processes: a modified PCA algorithm with continual learning abilityJingxin Zhang, Donghua Zhou, Maoyin ChenJournal of Process Control · Tsinghua University · Shandong University of Science and Technology
    PDF ↗
  19. 2019
    REFIT: A Unified Watermark Removal Framework For Deep Learning Systems With Limited DataXinyun Chen, Wenxiao Wang, Chris Bender … Dawn SongACM Asia Conference on Computer and Communications Security · University of California, Berkeley · Tsinghua University · +2
    PDF ↗
  20. 2021
    Enhanced prototypical network for few-shot relation extractionWen Wen, Yongbin Liu, Chunping Ouyang … Tonglee ChungInformation Processing & Management · Department of Science and Technology of Hunan Province · Tsinghua University
  21. 2021
    A Survey on Curriculum LearningXin Wang, Yudong Chen, Wenwu ZhuTPAMI · Tsinghua University
  22. 2021
    Transfer Learning for Sequence Generation: from Single-source to Multi-sourceXuancheng Huang, Jingfang Xu, Maosong Sun, Yang LiuACL · King Center · Tsinghua University · +2
    PDF ↗
  23. 2019
    Self-Reinforcing Unsupervised MatchingJiang Lu, Lei Li, Changshui ZhangTPAMI · Peking University · Huazhong University of Science and Technology · +1
    PDF ↗
  24. 2020
    Measuring Information Transfer in Neural NetworksXiao Zhang, Xingjian Li, Dejing Dou, Ji WuarXiv · Tsinghua University · Baidu (China)
    PDF ↗
  25. 2020
    IncDet: In Defense of Elastic Weight Consolidation for Incremental Object DetectionLiyang Liu, Zhanghui Kuang, Yimin Chen … Wayne ZhangTNNLS · University Town of Shenzhen · Tsinghua University · +2
  26. 2020
    Task-Agnostic Online Reinforcement Learning with an Infinite Mixture of Gaussian ProcessesMengdi Xu, Wenhao Ding, Jiacheng Zhu … Ding ZhaoNeurIPS · Carnegie Mellon University · Tsinghua University · +1
    PDF ↗
  27. 2020
  28. 2020
    Quality-Aware Neural Adaptive Video Streaming With Lifelong Imitation LearningTianchi Huang, Chao Zhou, Xin Yao … Lifeng SunIEEE Journal on Selected Areas in Communications · Tsinghua University · Kuaishou (China) · +1
  29. 2019
    Maintaining Discrimination and Fairness in Class Incremental LearningBowen Zhao, Xi Xiao, Guojun Gan … Shu‐Tao XiaCVPR · Peng Cheng Laboratory · Tsinghua University
    PDF ↗
  30. 2019
    A distributed incremental update scheme for probability distribution of wind power forecast errorMengshuo Jia, Chen Shen, Zhaojian WangInternational Journal of Electrical Power & Energy Systems · State Nuclear Power Technology Company (China) · Tsinghua University
    PDF ↗
  31. 2019
    OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep LearningQi She, Fan Feng, Xinyue Hao … Rosa H. M. ChanICRA · City University of Hong Kong · Tsinghua University · +4
    PDF ↗
  32. 2019
    Sharp Bounds for Genetic Drift in Estimation of Distribution AlgorithmsBenjamin Doerr, Weijie ZhengIEEE Transactions · Centre National de la Recherche Scientifique · École Polytechnique · +4
    PDF ↗
  33. 2020
    Lifelong Visual-Tactile Cross-Modal Learning for Robotic Material PerceptionWendong Zheng, Huaping Liu, Fuchun SunTNNLS · Hebei University of Technology · Tsinghua University
  34. 2020
    Multimodal Continual Learning Using Online Dictionary UpdatingFuchun Sun, Huaping Liu, Chao Yang, Bin FangIEEE TCDS · Foshan University · Tsinghua University
  35. 2020
    Continual Relation Learning via Episodic Memory Activation and ReconsolidationXu Han, Yi Dai, Tianyu Gao … Jie ZhouACL · Intelligent Systems Research (United States) · Intelligent Health (United Kingdom) · +3
  36. 2020
    Continual Learning for Natural Language Generation in Task-oriented Dialog SystemsFei Mi, Liangwei Chen, Mengjie Zhao … Boi FaltingsEMNLP · École Polytechnique Fédérale de Lausanne · LMU Klinikum · +2
    PDF ↗
  37. 2020
    Efficient and Robust Syslog Parsing for Network Devices in Datacenter NetworksShenglin Zhang, Ying Liu, Weibin Meng … Ming ZhangIEEE Access · Nankai University · Baidu (China) · +5
  38. 2020
    Transferring Pretrained Networks to Small Data via Category DecorrelationYing Jin, Zhangjie Cao, Mingsheng Long, Jianmin WangBMVC · Tsinghua University
  39. 2019
    Broad Learning for Robotic Material RecognitionZhaoxin Wang, Huaping Huaping Liu, Xinying XuChinese Automation Congress (CAC) · Taiyuan University of Technology · Tsinghua University
  40. 2019
    Introduction to the Special Section on Advances in Causal Discovery and InferenceJiuyong Li, Kun Zhang, Emre Kıcıman, Peng CuiACM Transactions · University of South Australia · Carnegie Mellon University · +2
  41. 2019
    Adversarial Feature Alignment: Avoid Catastrophic Forgetting in Incremental Task Lifelong LearningXin Yao, Tianchi Huang, Chenglei Wu … Lifeng SunNeural Computation · Tsinghua University
    PDF ↗
  42. 2020
    Generative Memory for Lifelong LearningXin Su, Shangqi Guo, Tian Tan, Feng ChenTNNLS · Beijing Advanced Sciences and Innovation Center · Tsinghua University · +1
  43. 2019
    Continual learning improves Internet video streamingFrancis Y. Yan, Hudson Ayers, Chenzhi Zhu … Keith WinsteinNetworked Systems Design and Implementation · Stanford University · Tsinghua University
    PDF ↗
  44. 2019
    Lifelong Learning for Heterogeneous Multi-Modal TasksHuaping Liu, Fuchun Sun, Bin FangICRA · Tsinghua University
  45. 2018
    $L1$ -Norm Batch Normalization for Efficient Training of Deep Neural NetworksShuang Wu, Guoqi Li, Lei Deng … Luping ShiTNNLS · Tsinghua University · University of California, Santa Barbara · +1
    PDF ↗
  46. 2018
    Enhancing CNN Incremental Learning Capability with an Expanded NetworkShanshan Cai, Zhuwei Xu, Zhichao Huang … C.‐C. Jay KuoIEEE International Conference on Multimedia and Expo (ICME) · University of Southern California · Tsinghua University
  47. 2015
    Unobtrusive Sensing Incremental Social Contexts Using Fuzzy Class Incremental LearningZhenyu Chen, Yiqiang Chen, Xingyu Gao … Chunyan MiaoICDM · North China Electric Power University · Chinese Academy of Sciences · +4
  48. 2015
    TSDPMM: Incorporating Prior Topic Knowledge into Dirichlet Process Mixture Models for Text ClusteringLinmei Hu, Juanzi Li, Xiaoli Li … Xuzhong WangEMNLP · Institute for Infocomm Research · Tsinghua University · +1
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.