Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

26 papers of 11,817Sort Recent · Most cited
  1. 2022
    Preserve Knowledge with Auxiliary Feature Extractor for Class Incremental LearningHuihui Jie, Yuesheng ZhuThe 5th International Conference on Control and Computer… · Peking University
  2. 2022
    Streaming Graph Neural Networks with Generative ReplayJunshan Wang, Wenhao Zhu, Guojie Song, Liang WangKDD · Alibaba Group (China) · Peking University
  3. 2021
    Continual Contrastive Learning for Image ClassificationZhiwei Lin, Yongtao Wang, Hongxiang LinIEEE International Conference on Multimedia and Expo (ICME) · Peking University
    PDF ↗
  4. 2022PDF ↗
  5. 2022
    Adaptive Orthogonal Projection for Batch and Online Continual LearningYiduo Guo, Wenpeng Hu, Dongyan Zhao, Bing LiuAAAI · Peking University · King University · +1
  6. 2021
    From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model CompressionRunxin Xu, Fuli Luo, Chengyu Wang … Fei HuangAAAI · Peking University · Alibaba Group (United States)
    PDF ↗
  7. 2022
    Alleviating Representational Shift for Continual Fine-tuningShibo Jie, Zhihong Deng, Ziheng LiCVPR · Peking University · Artificial Intelligence in Medicine (Canada)
    PDF ↗
  8. 2022
    Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic SamplesYu Xia, Quan Wang, Yajuan Lyu … Dai DaiACL · Peking University · Baidu (China)
  9. 2021
    Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential ObservationsZike Yan, Yuxin Tian, Xuesong Shi … Hongbin ZhaICCV · King University · Peking University · +1
    PDF ↗
  10. 2021
    Design and Development of an Intelligent Pet-Type Quadruped RobotFeng Gao, Chengjia Lei, Xingguo Long … Peiheng SongIEEE 4th International Conference on Multimedia Informati… · Peking University · Peng Cheng Laboratory · +1
  11. 2021
    Continual Multi-Agent Interaction Behavior Prediction With Conditional Generative MemoryHengbo Ma, Yaofeng Sun, Jiachen Li … Chiho ChoiRA-L · Honda (United States) · University of California, Berkeley · +1
  12. 2020
    Generative Feature Replay with Orthogonal Weight Modification for Continual LearningGehui Shen, Song Zhang, Xiang Chen, Zhihong DengIJCNN · Peking University
    PDF ↗
  13. 2021
    Adaptive Progressive Continual LearningJu Xu, Jin Ma, Xuesong Gao, Zhanxing ZhuTPAMI · Peking University · Shandong University · +4
  14. 2021
    Learning the Superpixel in a Non-iterative and Lifelong MannerLei Zhu, Qi She, Bin Zhang … Jie HuCVPR · Beijing University of Posts and Telecommunications · Peking University
    PDF ↗
  15. 2021
    Continual Learning by Using Information of Each Class HolisticallyWenpeng Hu, Qi Qin, Mengyu Wang … Bing LiuAAAI · Peking University
  16. 2021
    Continual Learning for Neural Machine TranslationYue Cao, Haoran Wei, Boxing Chen, Xiaojun WanNAACL · Peking University · Alibaba Group (United States)
  17. 2019
    Self-Reinforcing Unsupervised MatchingJiang Lu, Lei Li, Changshui ZhangTPAMI · Peking University · Huazhong University of Science and Technology · +1
    PDF ↗
  18. 2021
    Principal Gradient Direction and Confidence Reservoir Sampling for Continual LearningZhiyi Chen, Tong LinSpringer LNCS · Georgia Institute of Technology · Peking University · +1
    PDF ↗
  19. 2020
    Streaming Graph Neural Networks via Continual LearningJunshan Wang, Guojie Song, Yi Wu, Liang WangCIKM · Peking University · Alibaba Group (China)
    PDF ↗
  20. 2020
    Self-Supervised Learning Aided Class-Incremental Lifelong LearningSong Zhang, Gehui Shen, Huang, Jinsong, Deng, Zhi-HongarXiv · Peking University
    PDF ↗
  21. 2020
    IROS 2019 Lifelong Robotic Vision: Object Recognition Challenge [Competitions]Heechul Bae, Eoin Brophy, Rosa H. M. Chan … Liguang ZhouIEEE Robotics & Automation Magazine · Electronics and Telecommunications Research Institute · Dublin City University · +9
  22. 2020
    Disentangle-based Continual Graph Representation LearningXiaoyu Kou, Yankai Lin, Shaobo Liu … Yan ZhangEMNLP · Peking University · Tencent (China)
    PDF ↗
  23. 2020
    Using the Past Knowledge to Improve Sentiment ClassificationQi Qin, Wenpeng Hu, Bing LiuEMNLP · Peking University · King University
  24. 2019
    Bayesian Optimized Continual Learning with Attention MechanismJu Xu, Jin Ma, Zhanxing ZhuarXiv · Peking University
    PDF ↗
  25. 2018
    Life-long Cross-media Correlation LearningJinwei Qi, Yuxin Peng, Yunkan ZhuoACM international conference on Multimedia · Peking University
  26. 2014
    Error-Driven Incremental Learning in Deep Convolutional Neural Network for Large-Scale Image ClassificationTianjun Xiao, Jiaxing Zhang, Kuiyuan Yang … Zheng ZhangACM international conference on Multimedia · Peking University · Microsoft Research Asia (China)
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.