Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3601–3650Sort Recent · Most cited
  1. 2022
    Coarse-To-Fine Incremental Few-Shot LearningXiang Xiang, Yuwen Tan, Qian Wan … Gregory D. HagerECCV · Huazhong University of Science and Technology · Johns Hopkins University
    PDF ↗
  2. 2022
    Adaptive Resonance Theory-based Topological Clustering with a Divisive Hierarchical Structure Capable of Continual LearningNaoki Masuyama, Narito Amako, Yuna Yamada … Hisao IshibuchiIEEE Access · Osaka Metropolitan University · Osaka Prefecture University · +1
    PDF ↗
  3. 2022
    Continual Learning with Evolving Class OntologiesZhiqiu Lin, Deepak Pathak, Yu-Xiong Wang … Shu KongNeurIPS
    PDF ↗
  4. 2022
    Dataset Knowledge Transfer for Class-Incremental Learning without MemoryHabib Slim, Eden Belouadah, Adrian Popescu, Darian M. OnchişWACV · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +5
    PDF ↗
  5. 2022
    Visual Tracking by Adaptive Continual Meta-LearningJanghoon Choi, Sungyong Baik, Myungsub Choi … Kyoung Mu LeeIEEE Access · Kookmin University · Seoul National University · +1
    PDF ↗
  6. 2022
    Adaptive Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  7. 2022
    LPC: A Logits and Parameter Calibration Framework for Continual LearningXiaodi Li, Zhuoyi Wang, Dingcheng Li … Bhavani ThuraisinghamEMNLP · The University of Texas at Dallas · Baidu (China)
    PDF ↗
  8. 2022
    CLLE: A Benchmark for Continual Language Learning Evaluation in Multilingual Machine TranslationHan Zhang, Sheng Zhang, Yang Xiang … Ruifeng XuEMNLP · Harbin Institute of Technology · Peng Cheng Laboratory · +3
    PDF ↗
  9. 2022
    Continual Learning for Natural Language Generations with Transformer CalibrationPeng Yang, Dingcheng Li, Ping LiCoNLL · Bellevue Hospital Center · Cognitive Research (United States)
    PDF ↗
  10. 2022
    Contrastive Supervised Distillation for Continual Representation LearningTommaso Barletti, Niccolò Biondi, Federico Pernici … Alberto Del BimboSpringer LNCS · University of Florence
    PDF ↗
  11. 2022
    Avalanche RL: a Continual Reinforcement Learning LibraryNicoló Lucchesi, Antonio Carta, Vincenzo Lomonaco, Davide BacciuSpringer LNCS · University of Pisa
    PDF ↗
  12. 2022
    Class Incremental Learning for Intent Classification with Limited or No Old DataDebjit Paul, Daniil Sorokin, Judith GaspersFirst Workshop on Ever Evolving NLP (EvoNLP) · École Polytechnique Fédérale de Lausanne
    PDF ↗
  13. 2022
    Continual Learning of Long Topic Sequences in Neural Information Retrieval - abstractThomas Gerald, Laure SoulierSpringer LNCS · Centre National de la Recherche Scientifique · Sorbonne Université · +1
    PDF ↗
  14. 2022
    Continual Referring Expression Comprehension via Dual Modular MemorizationHeng Tao Shen, Cheng Chen, Peng Wang … Jingkuan SongTIP · University of Electronic Science and Technology of China · Peng Cheng Laboratory · +2
    PDF ↗
  15. 2022
    Entropy-Based Vocabulary Substitution for Incremental Learning in Multilingual Neural Machine TranslationKaiyu Huang, Peng Li, Jin Ma, Yang LiuEMNLP · Tsinghua University · Peng Cheng Laboratory · +5
    PDF ↗
  16. 2022
    Adaptive Neural Networks for Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  17. 2022
    Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement LearningRobin Schiewer, Laurenz WiskottSpringer LNCS · Ruhr University Bochum
    PDF ↗
  18. 2022
    Evaluating Continual Learning Algorithms by Generating 3D Virtual EnvironmentsEnrico Meloni, Alessandro Betti, Lapo Faggi … Stefano MelacciSpringer LNCS · University of Siena · University of Florence
    PDF ↗
  19. 2022
    Gating Mechanism in Deep Neural Networks for Resource-Efficient Continual LearningHyundong Jin, Kimin Yun, Eunwoo KimIEEE Access · Chung-Ang University · Electronics and Telecommunications Research Institute
    PDF ↗
  20. 2022
    Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in TransformersPhilip Kenneweg, Alexander Schulz, Sarah Schröder, Barbara HammerSpringer LNCS · Bielefeld University
    PDF ↗
  21. 2022
    Transfer Learning via Test-time Neural Networks AggregationBruno Casella, Alessio Barbaro Chisari, Sebastiano Battiato, Mario Valerio GiuffridaInternational Joint Conference on Computer Vision, Imagin… · University of Catania · University of Turin · +1
    PDF ↗
  22. 2022
    Improving Scheduled Sampling with Elastic Weight Consolidation for Neural Machine TranslationMichalis Korakakis, Andreas VlachosEMNLP · University of Cambridge
    PDF ↗
  23. 2022
    Logarithmic Continual LearningWojciech Masarczyk, Paweł Wawrzyński, Daniel Marczak … T. P. TrzcinskiIEEE Access · Warsaw University of Technology · Jagiellonian University
    PDF ↗
  24. 2022
    An empirical comparison of generators in replay-based continual learningNADZEYA DZEMIDOVICH, Alexander GepperthESANN 2022 proceedings · Fulda University of Applied Sciences
    PDF ↗
  25. 2022
    Continual Learning with Neuron Activation ImportanceSohee Kim, Seungkyu LeeSpringer LNCS · Kyung Hee University
    PDF ↗
  26. 2022
    Modular-Relatedness for Continual LearningAmmar Shaker, Francesco Alesiani, Shujian YuSpringer LNCS · UiT The Arctic University of Norway
    PDF ↗
  27. 2022
    Diverse Memory for Experience Replay in Continual LearningAndrii Krutsylo, Paweł MorawieckiESANN 2022 proceedings · Institute of Computer Science · Polish Academy of Sciences
    PDF ↗
  28. 2022
    Continual Incremental Language Learning for Neural Machine TranslationMichele Resta, Davide BacciuESANN 2022 proceedings · University of Pisa · Istituto Nazionale di Fisica Nucleare, Sezione di Pisa
    PDF ↗
  29. 2022
    Incremental Learning With Adaptive Model Search and a Nominal Loss ModelChanho Ahn, Eunwoo Kim, Songhwai OhIEEE Access · Seoul National University · Chung-Ang University
    PDF ↗
  30. 2022
    On Regret Bounds for Continual Single-Index LearningThe Tien MaiSpringer LNCS · Norwegian University of Science and Technology
    PDF ↗
  31. 2022
    Tutorial - Continual Learning beyond classificationAlexander Gepperth, Timothée LesortESANN 2022 proceedings · Fulda University of Applied Sciences · Université de Montréal
    PDF ↗
  32. 2022
    Foundational Models for Continual Learning: An Empirical Study of Latent ReplayOleksiy Ostapenko, Timothée Lesort, P. Rodríguez … Laurent CharlinarXiv
    PDF ↗
  33. 2022
    Task-Agnostic Continual Reinforcement Learning: In Praise of a Simple BaselineMassimo Caccia, Jonas W. Mueller, Taesup Kim … Rasool FakoorarXiv
    PDF ↗
  34. 2022PDF ↗
  35. 2022
    A simple but strong baseline for online continual learning: Repeated Augmented RehearsalYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
    PDF ↗
  36. 2022
    Scaling the Number of Tasks in Continual LearningTimothée Lesort, Oleksiy Ostapenko, Diganta Misra … I. RisharXiv
    PDF ↗
  37. 2022
    AI Autonomy: Self-Initiation, Adaptation and Continual LearningBing Liu, Sahisnu Mazumder, Eric Robertson, Scott GrigsbyarXiv
    PDF ↗
  38. 2022
    Is Continual Learning Truly Learning Representations Continually?Sungmin Cha, Dongsub Shim, Hyunwoo J. Kim … Taesup MoonarXiv
    PDF ↗
  39. 2022
    Memory Efficient Continual Learning for Neural Text ClassificationB. Ermi̇ş, Giovanni Zappella, Martin Wistuba, C. ArchambeauarXiv
    PDF ↗
  40. 2022PDF ↗
  41. 2022PDF ↗
  42. 2022PDF ↗
  43. 2022PDF ↗
  44. 2022
    Dynamic Dialogue Policy Transformer for Continual Reinforcement LearningChristian Geishauser, Carel van Niekerk, Nurul Lubis … Milica Gavsi'carXiv
    PDF ↗
  45. 2022PDF ↗
  46. 2022
    PlaStIL: Plastic and Stable Memory-Free Class-Incremental LearningGrégoire Petit, Adrian-Ştefan Popescu, Eden Belouadah … Bertrand DelezoidearXiv
    PDF ↗
  47. 2022PDF ↗
  48. 2022
    SimCS: Simulation for Online Domain-Incremental Continual SegmentationM. Alfarra, Zhipeng Cai, Adel Bibi … Matthias MüllerarXiv
    PDF ↗
  49. 2022PDF ↗
  50. 2022
    Continual learning of quantum state classification with gradient episodic memoryHaozhen Situ, Tianxiang Lu, Minghua Pan, Lvzhou LiarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.