Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

10 papers of 8,653Sort Recent · Most cited
  1. 2026
    To Retain or to Adapt? Generalizing Continual LearningGiulia Lanzillotta, Mandana Samiei, Doina Precup … Claire VernadearXiv
    PDF ↗
  2. 2025
    What Can Grokking Teach Us About Learning Under Nonstationarity?Clare Lyle, Gharda Sokar, Razvan Pascanu, Andr'as GyorgyarXiv
    PDF ↗
  3. 2023
    Towards Robust and Efficient Continual Language LearningAdam Fisch, Amal Rannen-Triki, Razvan Pascanu … Marc’Aurelio RanzatoarXiv
    PDF ↗
  4. 2023
    Towards Compute-Optimal Transfer LearningM. Caccia, Alexandre Galashov, Arthur Douillard … Razvan PascanuarXiv
    PDF ↗
  5. 2022
    NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision ResearchJörg Bornschein, Alexandre Galashov, Ross Hemsley … Marc’Aurelio RanzatoarXiv
    PDF ↗
  6. 2022
    Architecture Matters in Continual LearningSeyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin … Mehrdad FarajtabararXiv
    PDF ↗
  7. 2021
    Task-agnostic Continual Learning with Hybrid Probabilistic ModelsPolina Kirichenko, Mehrdad Farajtabar, Dushyant Rao … Razvan PascanuarXiv
    PDF ↗
  8. 2021
    A study on the plasticity of neural networksTudor Berariu, Wojciech Marian Czarnecki, Soham De … Claudia ClopatharXiv · Imperial College London
    PDF ↗
  9. 2019
    Task Agnostic Continual Learning via Meta LearningXu He, Jakub Sygnowski, Alexandre Galashov … Razvan PascanuarXiv · Google (United States)
    PDF ↗
  10. 2016
    Progressive Neural NetworksAndrei A. Rusu, Neil C. Rabinowitz, Guillaume Desjardins … Raia HadsellarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.