Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

14 papers of 11,817Sort Recent · Most cited
  1. 2025
    A Comparative Analysis of LLM Adaptation: SFT, LoRA, and ICL in Data-Scarce ScenariosBernd Bohnet, Rumen Dangovski, Kevin Swersky … Noah FiedelarXiv
    PDF ↗
  2. 2023
    Is forgetting less a good inductive bias for forward transfer?Jiefeng Chen, Timothy Nguyen, Dilan Gorur, Arslan ChaudhryICLR
    PDF ↗
  3. 2023
    Continually learning representations at scaleAlexandre Galashov, Jovana Mitrovic, Dhruva Tirumala … Razvan PascanuCoLLAs
  4. 2022
    NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision ResearchJörg Bornschein, Alexandre Galashov, Ross Hemsley … Marc’Aurelio RanzatoarXiv
    PDF ↗
  5. 2022
    Architecture Matters in Continual LearningSeyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin … Mehrdad FarajtabararXiv
    PDF ↗
  6. 2021
    Wide Neural Networks Forget Less CatastrophicallySeyed Iman Mirzadeh, Arslan Chaudhry, Yin, Dong … Mehrdad FarajtabarICML · Google (United States)
    PDF ↗
  7. 2019
    Using Hindsight to Anchor Past Knowledge in Continual LearningArslan Chaudhry, Albert Gordo, Puneet K. Dokania … David López-PazAAAI · University of Oxford · Meta (Israel)
    PDF ↗
  8. 2021
    MAML-CL: Edited Model-Agnostic Meta-Learning for Continual LearningMarcin Andrychowicz, Misha Denil, Sergio Gómez … Longxiang GaoPreprint
  9. 2020
    Continual Learning in Low-rank Orthogonal SubspacesArslan Chaudhry, Naeemullah Khan, Puneet K. Dokania, Philip H. S. TorrNeurIPS · University of Oxford
    PDF ↗
  10. 2020
  11. 2019
    On Tiny Episodic Memories in Continual LearningArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … M. RanzatoPreprint
  12. 2019
    Continual Learning with Tiny Episodic MemoriesArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … Marc’Aurelio RanzatoarXiv · University of Oxford
    PDF ↗
  13. 2018
    Efficient Lifelong Learning with A-GEMArslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, Mohamed ElhoseinyICLR
    PDF ↗
  14. 2018
    Riemannian Walk for Incremental Learning: Understanding Forgetting and IntransigenceArslan Chaudhry, Puneet K. Dokania, Thalaiyasingam Ajanthan, Philip H. S. TorrSpringer LNCS · University of Oxford
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.