Related work

The foundational work on continual learning, 1989 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

617 papers of 5,456 · showing 451–500Sort Recent · Most cited
  1. 2022
    Sequential changepoint detection in neural networks with checkpointsMichalis K. Titsias, Jakub Sygnowski, Yutian ChenStatistics and Computing · Google DeepMind (United Kingdom)
    PDF ↗
  2. 2022
    ELLE: Efficient Lifelong Pre-training for Emerging DataYujia Qin, Jiajie Zhang, Yankai Lin … Jie ZhouACL
    PDF ↗
  3. 2022
    Sparsity and Heterogeneous Dropout for Continual Learning in the Null Space of Neural ActivationsAli Abbasi, Parsa Nooralinejad, Vladimir Braverman … Soheil KolouriCoLLAs
    PDF ↗
  4. 2022
    Mind Your Manners! A Dataset and a Continual Learning Approach for Assessing Social Appropriateness of Robot ActionsJonas Tjomsland, Sinan Kalkan, Hatice GüneşFrontiers · University of Cambridge · Middle East Technical University
    PDF ↗
  5. 2022
    Controlling Soft Robotic Arms Using Continual LearningFrancesco Piqué, Hari Teja Kalidindi, Lorenzo Fruzzetti … Egidio FaloticoRA-L · Scuola Superiore Sant'Anna · National University of Singapore
  6. 2022PDF ↗
  7. 2022
    Lifelong 3D Object Recognition and Grasp Synthesis Using Dual Memory Recurrent Self-Organization NetworksKrishnakumar Santhakumar, Hamidreza KasaeiNeural Networks · University of Groningen
    PDF ↗
  8. 2022PDF ↗
  9. 2022
    Acceleration of Federated Learning with Alleviated Forgetting in Local TrainingChencheng Xu, Zhiwei Hong, Minlie Huang, Tao JiangICLR
    PDF ↗
  10. 2022PDF ↗
  11. 2022
    Provable and Efficient Continual Representation LearningYingcong Li, Mingchen Li, M. Salman Asif, Samet OymakarXiv
    PDF ↗
  12. 2022
    Continual Learning of Multi-modal Dynamics with External MemoryAbdullah Akgül, Gözde Ünal, Melih KandemirConference on Learning for Dynamics & Control · University of Southern Denmark · Istanbul Technical University
    PDF ↗
  13. 2022
    A Versatile Agent for Fast Learning from Human InstructorsYiwen Chen, Zedong Zhang, Haofeng Liu … Marcelo H. AngarXiv
    PDF ↗
  14. 2022
    Memory Consolidation with Orthogonal Gradients for avoiding Catastrophic ForgettingTamizharasan Kanagamani, Rupak Krishnamurthy, V. Srinivasa Chakravarthy … Ramshekhar N. MenonbioRxiv · Indian Institute of Technology Madras · Robert Bosch (India) · +1
  15. 2022
    BERT WEAVER: Using WEight AVERaging to Enable Lifelong Learning for Transformer-based ModelsKühnel, Lisa, Alexander Schulz, Barbara Hammer, Juliane FluckarXiv
    PDF ↗
  16. 2022
    Diagnosing Batch Normalization in Class Incremental LearningMinghao Zhou, Quanziang Wang, Jun Shu … Deyu MengarXiv
    PDF ↗
  17. 2022
    Memory Replay with Data Compression for Continual LearningLiyuan Wang, Xingxing Zhang, Kuo Yang … Jun ZhuICLR
    PDF ↗
  18. 2022PDF ↗
  19. 2022PDF ↗
  20. 2022
    Graph Few-shot Class-incremental LearningZhen Tan, Kaize Ding, Ruocheng Guo, Huan LiuWSDM · Arizona State University · City University of Hong Kong
    PDF ↗
  21. 2022
    Deep Bayesian Unsupervised Lifelong LearningTingting Zhao, Zifeng Wang, Aria Masoomi, Jennifer DyNeural Networks · Bryant University · Bryan College · +1
    PDF ↗
  22. 2022
    A Neural Network Model of Continual Learning with Cognitive ControlJacob Russin, Maryam Zolfaghar, Seongmin A. Park … Randall C. O’ReillyCognitive Science
    PDF ↗
  23. 2022PDF ↗
  24. 2022
    TRGP: Trust Region Gradient Projection for Continual LearningSen Lin, Li Yang, Deliang Fan, Junshan ZhangICLR
    PDF ↗
  25. 2022
    Improving Pedestrian Prediction Models With Self-Supervised Continual LearningLuzia Knoedler, Chadi Salmi, Hai Zhu … Javier Alonso–MoraRA-L · Delft University of Technology
    PDF ↗
  26. 2022
    Catastrophic Forgetting in Deep Graph Networks: A Graph Classification BenchmarkAntonio Carta, Andrea Cossu, Federico Errica, Davide BacciuFrontiers · University of Pisa · Scuola Normale Superiore
  27. 2022
    Architecture Matters in Continual LearningSeyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin … Mehrdad FarajtabararXiv
    PDF ↗
  28. 2022PDF ↗
  29. 2022PDF ↗
  30. 2022PDF ↗
  31. 2022
    Knowledge extraction and retention based continual learning by using convolutional autoencoder-based learning classifier systemMuhammad Irfan, Jiangbin Zheng, Muhammad Iqbal … Muhammad Hassan ArifInformation Sciences · Northwestern Polytechnical University · Higher Colleges of Technology · +1
  32. 2022
    RD-IOD: Two-Level Residual-Distillation-Based Triple-Network for Incremental Object DetectionDongbao Yang, Yu Zhou, Wei Shi … Weiping WangACM Transactions · University of Chinese Academy of Sciences · Chinese Academy of Sciences · +1
  33. 2022
    The CLEAR Benchmark: Continual LEArning on Real-World ImageryZhiqiu Lin, Jia Shi, Deepak Pathak, Deva RamananNeurIPS
    PDF ↗
  34. 2022
    Efficient On-Device Incremental Learning by Weight FreezingZe-Han Wang, Zhenli He, Hui Fang … Ди ЛюAsia and South Pacific Design Automation Conference (ASP-… · Yunnan University
  35. 2022
    XBM: A Crossbar Column-wise Binary Mask Learning Method for Efficient Multiple Task AdaptionFan Zhang, Yang Li, Jian Meng … Deliang FanAsia and South Pacific Design Automation Conference (ASP-… · Arizona State University
  36. 2022
    Lifelong Generative Learning via Knowledge ReconstructionLibo Huang, Zhulin An, Xiang Zhi, Yongjun XuarXiv
    PDF ↗
  37. 2022PDF ↗
  38. 2022
    Brain-inspired global-local learning incorporated with neuromorphic computingYujie Wu, Rong Zhao, Jun Zhu … Luping ShiNature Communications · Tsinghua University · Chinese Institute for Brain Research · +1
    PDF ↗
  39. 2022
    Continual learning classification method with the weighted k-nearest neighbor rule for time-varying data space based on the artificial immune systemDong Li, Ming Gu, Shulin Liu … Kun QianKnowledge-Based Systems · Changzhou University · Shanghai University
  40. 2022PDF ↗
  41. 2022
    Towards Unsupervised Open World Semantic SegmentationSvenja Uhlemeyer, Matthias Rottmann, Hanno GottschalkUAI
    PDF ↗
  42. 2022
    TimeLMs: Diachronic Language Models from TwitterDaniel Loureiro, Francesco Barbieri, Leonardo Neves … Jose Camacho-colladosACL · Universidade do Porto · Snap (United States) · +2
    PDF ↗
  43. 2022
    Preservation of the Global Knowledge by Not-True Distillation in Federated LearningGihun Lee, Minchan Jeong, Yongjin Shin … Se-Young YunNeurIPS
    PDF ↗
  44. 2022
    Fine-tuned Language Models are Continual LearnersThomas Scialom, Tuhin Chakrabarty, Smaranda MuresanEMNLP · University of Missouri · Columbia University
    PDF ↗
  45. 2022
    Lifelong Pretraining: Continually Adapting Language Models to Emerging CorporaXisen Jin, Dejiao Zhang, Henghui Zhu … Xiang RenNAACL · University of Southern California · California Southern University
    PDF ↗
  46. 2022
    CGLB: Benchmark Tasks for Continual Graph LearningXikun Zhang, Dongjin Song, Dacheng TaoNeurIPS
  47. 2022
    Memory Efficient Continual Learning with TransformersBeyza Ermis, Giovanni Zappella, Martin Wistuba … Cédric ArchambeauNeurIPS
    PDF ↗
  48. 2022
    Overcoming Catastrophic Forgetting During Domain Adaptation of Seq2seq Language GenerationDingcheng Li, Zheng Chen, Eunah Cho … Yang LiuNAACL · Amazon (United States)
  49. 2022
    S3C: Self-Supervised Stochastic Classifiers for Few-Shot Class-Incremental LearningJayateja Kalla, Soma BiswasECCV · Indian Institute of Science Bangalore
    PDF ↗
  50. 2022
    Repeated Augmented Rehearsal: A Simple but Strong Baseline for Online Continual LearningYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.