Related work

The foundational work on continual learning, 1989 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

617 papers of 5,456 · showing 501–550Sort Recent · Most cited
  1. 2022
    Retrospective Adversarial Replay for Continual LearningLilly Kumari, Shengjie Wang, Tianyi Zhou, Jeff BilmesNeurIPS
  2. 2022
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  3. 2022
    Multi-Domain Incremental Learning for Semantic SegmentationPrachi Garg, Rohit Saluja, Vineeth N Balasubramanian … C. V. JawaharWACV · Indian Institute of Technology Hyderabad · Indian Institute of Technology Delhi
    PDF ↗
  4. 2022
    Rethinking Video Anomaly Detection - A Continual Learning ApproachKeval Doshi, Yasin YılmazWACV · University of South Florida
  5. 2022
    Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic SamplesYu Xia, Quan Wang, Yajuan Lyu … Dai DaiACL · Peking University · Baidu (China)
  6. 2022
    Helpful or Harmful: Inter-task Association in Continual LearningHyundong Jin, Eunwoo KimECCV · Chung-Ang University
  7. 2022
    Practical Recommendations for Replay-based Continual Learning MethodsGabriele Merlin, Vincenzo Lomonaco, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  8. 2022
    Multi-Granularity Regularized Re-Balancing for Class Incremental LearningHuitong Chen, Yu Wang, Qinghua HuTKDE · Tianjin University · Tianjin haihe hospital
    PDF ↗
  9. 2022
    Unsupervised Continual Learning Via Pseudo LabelsJiangpeng He, Fengqing ZhuSpringer LNCS · Purdue University West Lafayette
    PDF ↗
  10. 2022
    Few-Shot Class-Incremental Learning for Named Entity RecognitionRui Wang, Tong Yu, Handong Zhao … Ricardo HenaoACL · Duke University · Adobe Systems (United States)
  11. 2022
    Prompt-Based Prototypical Framework for Continual Relation ExtractionHan Zhang, Bin Liang, Min Yang … Ruifeng XuIEEE/ACM Transactions on Audio Speech and Language Proces… · Shenzhen Institute of Information Technology · Harbin Institute of Technology · +2
  12. 2022
    Online Task-free Continual Learning with Dynamic Sparse Distributed MemoryJulien Pourcel, Ngoc‐Son Vu, Robert M. FrenchECCV · Centre National de la Recherche Scientifique · Equipes Traitement de l'Information et Systèmes · +1
  13. 2022
  14. 2022
    Differential Privacy Preservation in Robust Continual LearningAhmad Hassanpour, Majid Moradikia, Bian Yang … Julián FiérrezIEEE Access · Norwegian University of Science and Technology · University of Houston · +1
    PDF ↗
  15. 2022
    Online Continual Learning Via Candidates VotingJiangpeng He, Fengqing ZhuWACV · Purdue University West Lafayette
    PDF ↗
  16. 2022
    Learning Representations for New Sound Classes With Continual Self-Supervised LearningZhepei Wang, Cem Subakan, Xilin Jiang … Paris SmaragdisIEEE Signal Processing Letters · University of Illinois Urbana-Champaign · Concordia University · +2
    PDF ↗
  17. 2022
    Knowledge Capture and Replay for Continual LearningSaisubramaniam Gopalakrishnan, Pranshu Ranjan Singh, Haytham M. Fayek … ArulMurugan AmbikapathiWACV · Agency for Science, Technology and Research · Institute for Infocomm Research · +1
    PDF ↗
  18. 2022
    SPeCiaL: Self-Supervised Pretraining for Continual LearningLucas Caccia, Joëlle PineauSpringer LNCS · McGill University
    PDF ↗
  19. 2022
    Continual Learning In Environments With Polynomial Mixing TimesMatthew Riemer, Sharath Chandra Raparthy, Ignacio Cases … Irina RishNeurIPS
    PDF ↗
  20. 2022
    incDFM: Incremental Deep Feature Modeling for Continual Novelty DetectionAmanda Rios, Nilesh Ahuja, Ibrahima J. Ndiour … Omesh TickooECCV · University of Southern California · Intel (United States)
  21. 2022
    Knowledge Lock: Overcoming Catastrophic Forgetting in Federated LearningGuoyizhe Wei, Xiu LiSpringer LNCS · University Town of Shenzhen · Tsinghua University
  22. 2022
    Coarse-To-Fine Incremental Few-Shot LearningXiang Xiang, Yuwen Tan, Qian Wan … Gregory D. HagerECCV · Huazhong University of Science and Technology · Johns Hopkins University
    PDF ↗
  23. 2022
    Adaptive Resonance Theory-based Topological Clustering with a Divisive Hierarchical Structure Capable of Continual LearningNaoki Masuyama, Narito Amako, Yuna Yamada … Hisao IshibuchiIEEE Access · Osaka Metropolitan University · Osaka Prefecture University · +1
    PDF ↗
  24. 2022
    Balancing Between Forgetting and Acquisition in Incremental Subpopulation LearningMingfu Liang, Jiahuan Zhou, Wei Wei, Ying WuECCV · Northwestern University · Peking University
  25. 2022
    Reducing Catastrophic Forgetting in Neural Networks via Gaussian Mixture ApproximationHoang Phan, Anh Phan Tuan, Son Nguyen … Khoat ThanSpringer LNCS · VinUniversity · Hanoi University of Science and Technology
  26. 2022
    Thalamocortical contribution to flexible learning in neural systemsMien Brabeeba Wang, Michael M. HalassaNetwork Neuroscience · Massachusetts Institute of Technology
  27. 2022
    Auxiliary Local Variables for Improving Regularization/Prior Approach in Continual LearningLinh Ngo Van, Nam Le Hai, Hoang Pham, Khoat ThanSpringer LNCS · Hanoi University of Science and Technology
  28. 2022
    Continual Learning with Evolving Class OntologiesZhiqiu Lin, Deepak Pathak, Yu-Xiong Wang … Shu KongNeurIPS
    PDF ↗
  29. 2022
    Dataset Knowledge Transfer for Class-Incremental Learning without MemoryHabib Slim, Eden Belouadah, Adrian Popescu, Darian M. OnchişWACV · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +5
    PDF ↗
  30. 2022
    Visual Tracking by Adaptive Continual Meta-LearningJanghoon Choi, Sungyong Baik, Myungsub Choi … Kyoung Mu LeeIEEE Access · Kookmin University · Seoul National University · +1
    PDF ↗
  31. 2022
    Adaptive Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  32. 2022
    LPC: A Logits and Parameter Calibration Framework for Continual LearningXiaodi Li, Zhuoyi Wang, Dingcheng Li … Bhavani ThuraisinghamEMNLP · The University of Texas at Dallas · Baidu (China)
    PDF ↗
  33. 2022
    CLLE: A Benchmark for Continual Language Learning Evaluation in Multilingual Machine TranslationHan Zhang, Sheng Zhang, Yang Xiang … Ruifeng XuEMNLP · Harbin Institute of Technology · Peng Cheng Laboratory · +3
    PDF ↗
  34. 2022
    Continual Learning for Natural Language Generations with Transformer CalibrationPeng Yang, Dingcheng Li, Ping LiCoNLL · Bellevue Hospital Center · Cognitive Research (United States)
    PDF ↗
  35. 2022
    Contrastive Supervised Distillation for Continual Representation LearningTommaso Barletti, Niccolò Biondi, Federico Pernici … Alberto Del BimboSpringer LNCS · University of Florence
    PDF ↗
  36. 2022
    Domain adaptation and continual learning in semantic segmentationUmberto Michieli, Marco Toldo, Pietro ZanuttighElsevier · University of Padua
  37. 2022
    Avalanche RL: a Continual Reinforcement Learning LibraryNicoló Lucchesi, Antonio Carta, Vincenzo Lomonaco, Davide BacciuSpringer LNCS · University of Pisa
    PDF ↗
  38. 2022
    Class Incremental Learning for Intent Classification with Limited or No Old DataDebjit Paul, Daniil Sorokin, Judith GaspersFirst Workshop on Ever Evolving NLP (EvoNLP) · École Polytechnique Fédérale de Lausanne
    PDF ↗
  39. 2022
    Continual Learning of Long Topic Sequences in Neural Information Retrieval - abstractThomas Gerald, Laure SoulierSpringer LNCS · Centre National de la Recherche Scientifique · Sorbonne Université · +1
    PDF ↗
  40. 2022
    Continual Referring Expression Comprehension via Dual Modular MemorizationHeng Tao Shen, Cheng Chen, Peng Wang … Jingkuan SongTIP · University of Electronic Science and Technology of China · Peng Cheng Laboratory · +2
    PDF ↗
  41. 2022
    Entropy-Based Vocabulary Substitution for Incremental Learning in Multilingual Neural Machine TranslationKaiyu Huang, Peng Li, Jin Ma, Yang LiuEMNLP · Tsinghua University · Peng Cheng Laboratory · +5
    PDF ↗
  42. 2022
    Adaptive Feature Generation for Online Continual Learning from Imbalanced DataYingchun Jian, Jinfeng Yi, Lijun ZhangSpringer LNCS · Nanjing University · Jingdong (China)
  43. 2022
    Adaptive Neural Networks for Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  44. 2022
    Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement LearningRobin Schiewer, Laurenz WiskottSpringer LNCS · Ruhr University Bochum
    PDF ↗
  45. 2022
    Evaluating Continual Learning Algorithms by Generating 3D Virtual EnvironmentsEnrico Meloni, Alessandro Betti, Lapo Faggi … Stefano MelacciSpringer LNCS · University of Siena · University of Florence
    PDF ↗
  46. 2022
    Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in TransformersPhilip Kenneweg, Alexander Schulz, Sarah Schröder, Barbara HammerSpringer LNCS · Bielefeld University
    PDF ↗
  47. 2022
    Transfer Learning via Test-time Neural Networks AggregationBruno Casella, Alessio Barbaro Chisari, Sebastiano Battiato, Mario Valerio GiuffridaInternational Joint Conference on Computer Vision, Imagin… · University of Catania · University of Turin · +1
    PDF ↗
  48. 2022
  49. 2022
    Computationally Efficient Rehearsal for Online Continual LearningCharalampos Davalas, Dimitrios Michail, Christos Diou … Konstantinos TserpesSpringer LNCS · Harokopio University of Athens
  50. 2022
    Gradient Regularization with Multivariate Distribution of Previous Knowledge for Continual LearningTaeheon Kim, Hyung-Jun Moon, Sung‐Bae ChoSpringer LNCS · Yonsei University
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.