Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

720 papers of 6,984 · showing 601–650Sort Recent · Most cited
  1. 2022
    Logarithmic Continual LearningWojciech Masarczyk, Paweł Wawrzyński, Daniel Marczak … T. P. TrzcinskiIEEE Access · Warsaw University of Technology · Jagiellonian University
    PDF ↗
  2. 2022
    A Novel Continual Learning Approach for Competitive Neural NetworksEsteban J. Palomo, Juan Miguel Ortiz-de-Lazcano-Lobato, José David Fernández-Rodríguez … Rosa Maza-QuirogaSpringer LNCS · Instituto de Investigación Biomédica de Málaga · Universidad de Málaga
  3. 2022
    An empirical comparison of generators in replay-based continual learningNADZEYA DZEMIDOVICH, Alexander GepperthESANN 2022 proceedings · Fulda University of Applied Sciences
    PDF ↗
  4. 2022
    Catastrophic Forgetting in Continual Concept Bottleneck ModelsEmanuele Marconato, Gianpaolo Bontempo, Stefano Teso … Andrea PasseriniSpringer LNCS · University of Pisa · University of Trento · +1
  5. 2022
    Continual Learning with Neuron Activation ImportanceSohee Kim, Seungkyu LeeSpringer LNCS · Kyung Hee University
    PDF ↗
  6. 2022
    Modular-Relatedness for Continual LearningAmmar Shaker, Francesco Alesiani, Shujian YuSpringer LNCS · UiT The Arctic University of Norway
    PDF ↗
  7. 2022
    CLFM: Few-Shot Object Detection via Low-Resource Contrastive Learning and Fisher Matrix Updating for Overcoming Catastrophic ForgettingMeng Wang, Qiang Wang, Haipeng LiuIEEE Access · Kunming University of Science and Technology
    PDF ↗
  8. 2022
    Continual Reinforcement Learning with Multi-Timescale Successor FeaturesRaymond Chua, Blake Richards, Doina Precup, Christos KaplanisConference on Cognitive Computational Neuroscience · McGill University · Google DeepMind (United Kingdom)
  9. 2022
    Diverse Memory for Experience Replay in Continual LearningAndrii Krutsylo, Paweł MorawieckiESANN 2022 proceedings · Institute of Computer Science · Polish Academy of Sciences
    PDF ↗
  10. 2022
    Transfer and Continual Supervised Learning for Robotic Grasping Through Grasping FeaturesLuca Monorchio, Marco Capotondi, Mario Corsanici … Francesco PujaSpringer LNCS · Sapienza University of Rome
  11. 2022
    Continual Incremental Language Learning for Neural Machine TranslationMichele Resta, Davide BacciuESANN 2022 proceedings · University of Pisa · Istituto Nazionale di Fisica Nucleare, Sezione di Pisa
    PDF ↗
  12. 2022
    Incremental Learning With Adaptive Model Search and a Nominal Loss ModelChanho Ahn, Eunwoo Kim, Songhwai OhIEEE Access · Seoul National University · Chung-Ang University
    PDF ↗
  13. 2022
    Metric Learning with Distillation for Overcoming Catastrophic ForgettingPiaoyao Yu, Juanjuan He, Qilang Min, Qi ZhuSpringer CCIS · Wuhan University of Science and Technology
  14. 2022
    Self-supervised Novelty Detection for Continual Learning: A Gradient-Based Approach Boosted by Binary ClassificationJingbo Sun, Li Yang, Jiaxin Zhang … Yu CaoSpringer LNCS · Arizona State University · Oak Ridge National Laboratory · +1
  15. 2022
    Continual Learning Based on Knowledge Distillation and Representation LearningXiuyan Chen, Jian–wei Liu, Wentao LiSpringer LNCS · China University of Petroleum, Beijing
  16. 2022
    Continual Learning with Score Pseudo Label for Instance SegmentationYinhe Han, Xiaojuan Liao, guangzhu chen … Qingjun RuSocial Science Research Network · Chengdu University of Technology · Chengdu University
  17. 2022
    Difficulty-Aware Mixup for Replay-based Continual LearningYu-Kai Ling, Ren Yang, Sheng‐De WangSpringer CCIS · National Taiwan University
  18. 2022
    On Regret Bounds for Continual Single-Index LearningThe Tien MaiSpringer LNCS · Norwegian University of Science and Technology
    PDF ↗
  19. 2022
    Opponent modeling with trajectory representation clusteringYongliang Lv, Yan Zheng, Jianye HaoIntelligence & Robotics · Tianjin University
    PDF ↗
  20. 2022
    Partially Relaxed Masks for Knowledge Transfer Without Forgetting in Continual LearningTatsuya Konishi, Mori Kurokawa, Chihiro Ono … Bing LiuSpringer LNCS · KDDI Research (Japan) · University of Illinois Chicago
  21. 2022
    Tutorial - Continual Learning beyond classificationAlexander Gepperth, Timothée LesortESANN 2022 proceedings · Fulda University of Applied Sciences · Université de Montréal
    PDF ↗
  22. 2022
    Effect of scale on catastrophic forgetting in neural networksV. Ramasesh, Aitor Lewkowycz, Ethan DyerICLR
  23. 2022
    Forget-free Continual Learning with Winning SubnetworksHaeyong Kang, R. Mina, Sultan Rizky Hikmawan Madjid … C. YooICML
  24. 2022
  25. 2022
    Pretrained Language Model in Continual Learning: A Comparative StudyTongtong Wu, Massimo Caccia, Zhuang Li … Gholamreza HaffariICLR
  26. 2022
    Looking Back on Learned Experiences For Class/task Incremental LearningMozhgan Pourkeshavarz, Guoying Zhao, M. SabokrouICLR
  27. 2022
    Continual Learning with Filter Atom SwappingZichen Miao, Ze Wang, Wei Chen, Qiang QiuICLR
  28. 2022
  29. 2022
    Foundational Models for Continual Learning: An Empirical Study of Latent ReplayOleksiy Ostapenko, Timothée Lesort, P. Rodríguez … Laurent CharlinarXiv
  30. 2022
  31. 2022
    Task-Agnostic Continual Reinforcement Learning: In Praise of a Simple BaselineMassimo Caccia, Jonas W. Mueller, Taesup Kim … Rasool FakoorarXiv
  32. 2022
    Federated Continual Learning with Differentially Private Data SharingGiulio Zizzo, Ambrish Rawat, N. Holohan, Seshu TirupathiPreprint
  33. 2022
  34. 2022
    A simple but strong baseline for online continual learning: Repeated Augmented RehearsalYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
  35. 2022
  36. 2022
    Scaling the Number of Tasks in Continual LearningTimothée Lesort, Oleksiy Ostapenko, Diganta Misra … I. RisharXiv
  37. 2022
    Few-Shot Regularization to Tackle Catastrophic Forgetting in Multilingual Machine TranslationSalvador Carrión-Ponz, F. CasacubertaConference of the Association for Machine Translation in…
  38. 2022
    AI Autonomy: Self-Initiation, Adaptation and Continual LearningBing Liu, Sahisnu Mazumder, Eric Robertson, Scott GrigsbyarXiv
  39. 2022
  40. 2022
    Speeding-up Continual Learning through Information Gains in Novel ExperiencesPierrick Lorang, Shivam Goel, Patrik Zips … matthias. scheutzPreprint
  41. 2022
    Efficient Continual Learning Ensembles in Neural Network SubspacesT. Doan, Seyed Iman Mirzadeh, Joelle Pineau, Mehrdad FarajtabararXiv
  42. 2022
    Is Continual Learning Truly Learning Representations Continually?Sungmin Cha, Dongsub Shim, Hyunwoo J. Kim … Taesup MoonarXiv
  43. 2022
    Memory Efficient Continual Learning for Neural Text ClassificationB. Ermi̇ş, Giovanni Zappella, Martin Wistuba, C. ArchambeauarXiv
  44. 2022
    Continual Learning through Hamilton EquationsAlessandro Betti, Lapo Faggi, M. Gori … S. MelacciCoLLAs
  45. 2022
    Deep Learning for Class-Incremental Learning: A surveyDa-Wei Zhou, Fu Lee Wang, Han-Jia Ye, De-chuan ZhanPreprint
  46. 2022
  47. 2022
  48. 2022
  49. 2022
  50. 2022
    Task-Balanced Batch Normalization for Exemplar-based Class-Incremental LearningSungmin Cha, Soonwon Hong, Moontae Lee, Taesup MoonarXiv
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.