Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

14 papers of 8,653Sort Recent · Most cited
  1. 2026
    CoPeP: Benchmarking Continual Pretraining for Protein Language ModelsDarshan Patil, Pranshu Malviya, Mathieu Reymond … Sarath ChandararXiv
    PDF ↗
  2. 2025
    Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language ModelsIstabrak Abbes, Gopeshh Subbaraj, Matthew Riemer … Irina RisharXiv
    PDF ↗
  3. 2025
    Continual Learning in Large Language Models: Foundations to FrontiersP. K. Srijith, Shrey Satapara, Sarath ChandarInternational Joint Conference on Natural Language Proces… · Indian Immunologicals (India) · Indian Institute of Technology Hyderabad · +4
    PDF ↗
  4. 2024
    Towards Practical Tool Usage for Continually Learning LLMsJerry Huang, Prasanna Parthasarathi, Mehdi Rezagholizadeh, Sarath ChandararXiv
    PDF ↗
  5. 2024
    Lookbehind-SAM: k steps back, 1 step forwardGonçalo Mordido, Pranshu Malviya, Aristide Baratin, Sarath ChandarICML
    PDF ↗
  6. 2023
    Replay Buffer with Local Forgetting for Adapting to Local Environment Changes in Deep Model-Based Reinforcement LearningAli Rahimi-Kalahroudi, Janarthanan Rajendran, Ida Momennejad … Sarath ChandarCoLLAs
    PDF ↗
  7. 2022
    An Introduction to Lifelong Supervised LearningShagun Sodhani, Mojtaba Faramarzi, Sanket Vaibhav Mehta … Sarath ChandararXiv
    PDF ↗
  8. 2023
    An Empirical Investigation of the Role of Pre-training in Lifelong LearningSanket Vaibhav Mehta, Darshan Patil, Sarath Chandar, Emma StrubellJMLR
    PDF ↗
  9. 2021
    IIRC: Incremental Implicitly-Refined ClassificationMohamed Abdelsalam, Mojtaba Faramarzi, Shagun Sodhani, Sarath ChandarCVPR · Mila - Quebec Artificial Intelligence Institute · Université de Montréal · +3
    PDF ↗
  10. 2022
    TAG: Task-based Accumulated Gradients for Lifelong learningPranshu Malviya, Balaraman Ravindran, Sarath ChandarCoLLAs
    PDF ↗
  11. 2021
    Continuous Coordination As a Realistic Scenario for Lifelong LearningHadi Nekoei, Akilesh Badrinaaraayanan, Aaron Courville, Sarath ChandarICML · Centre Universitaire de Mila · Université de Montréal · +1
    PDF ↗
  12. 2020
    Chaotic Continual LearningTouraj Laleh, Mojtaba Faramarzi, I. Rish, Sarath ChandarPreprint
  13. 2020
    Toward Training Recurrent Neural Networks for Lifelong LearningShagun Sodhani, Sarath Chandar, Yoshua BengioNeural Computation · Université de Montréal
  14. 2018
    On Training Recurrent Neural Networks for Lifelong LearningShagun Sodhani, Sarath Chandar, Yoshua BengioNeural Computation
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.