Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

16 papers of 11,817Sort Recent · Most cited
  1. 2026
    Modular Memory is the Key to Continual Learning AgentsVaggelis Dorovatas, M. Schwerin, Andrew D. Bagdanov … Rahaf AljundiarXiv
    PDF ↗
  2. 2024
    Integrating Present and Past in Unsupervised Continual LearningYipeng Zhang, Laurent Charlin, R. Zemel, Mengye RenCoLLAs
    PDF ↗
  3. 2023
    Towards Compute-Optimal Transfer LearningMassimo Caccia, Alexandre Galashov, Arthur Douillard … Razvan PascanuarXiv
    PDF ↗
  4. 2023
    From IID to the Independent Mechanisms assumption in continual learningOleksiy Ostapenko, Pau Rodríguez López, Alexandre Lacoste, Laurent CharlinAAAI
  5. 2022
    Challenging Common Assumptions about Catastrophic Forgetting and Knowledge AccumulationTimothée Lesort, Оleksiy Ostapenko, Diganta Misra … Irina RishCoLLAs
    PDF ↗
  6. 2022
    Task-Agnostic Continual Reinforcement Learning: Gaining Insights and Overcoming ChallengesM. Caccia, Jonas Mueller, Taesup Kim … Rasool FakoorCoLLAs
    PDF ↗
  7. 2022
    Continual Learning with Foundation Models: An Empirical Study of Latent ReplayОleksiy Ostapenko, Timothée Lesort, Pau Rodríguez … Laurent CharlinCoLLAs
    PDF ↗
  8. 2022
    Foundational Models for Continual Learning: An Empirical Study of Latent ReplayOleksiy Ostapenko, Timothée Lesort, P. Rodríguez … Laurent CharlinarXiv
  9. 2022
    Task-Agnostic Continual Reinforcement Learning: In Praise of a Simple BaselineMassimo Caccia, Jonas W. Mueller, Taesup Kim … Rasool FakoorarXiv
  10. 2022
    Scaling the Number of Tasks in Continual LearningTimothée Lesort, Oleksiy Ostapenko, Diganta Misra … I. RisharXiv
  11. 2021
    Continual Learning via Local Module CompositionOleksiy Ostapenko, Pau Rodríguez, M. Caccia, Laurent CharlinNeurIPS · Taras Shevchenko National University of Kyiv · University of Insubria · +1
    PDF ↗
  12. 2021
    Sequoia: A Software Framework to Unify Continual Learning ResearchFabrice Normandin, Florian Golemo, Oleksiy Ostapenko … M. CacciaarXiv
    PDF ↗
  13. 2020
    Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual LearningM. Caccia, Pau Rodríguez, Оleksiy Ostapenko … Laurent CharlinNeurIPS
    PDF ↗
  14. 2020
    Online Fast Adaptation and Knowledge Accumulation (OSAKA): a New Approach to Continual LearningMassimo Caccia, Pau Rodríguez López, Oleksiy Ostapenko … Laurent CharlinNeurIPS
  15. 2019
    Continual Learning of New Sound Classes Using Generative ReplayZhepei Wang, Cem Subakan, Efthymios Tzinis … Laurent CharlinIEEE Workshop on Applications of Signal Processing to Aud… · University of Illinois Urbana-Champaign · Mila - Quebec Artificial Intelligence Institute
    PDF ↗
  16. 2019
    Online Continual Learning with Maximally Interfered RetrievalRahaf Aljundi, Lucas Caccia, Eugene Belilovsky … Tinne TuytelaarsarXiv · McGill University · Université de Montréal · +1
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.