Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

17 papers of 11,817Sort Recent · Most cited
  1. 2025
    Barriers for Learning in an Evolving World: Mathematical Understanding of Loss of PlasticityA. Joudaki, Giulia Lanzillotta, Mohammad Samragh Razlighi … Fartash FaghriarXiv
    PDF ↗
  2. 2025
    TiC-LM: A Web-Scale Benchmark for Time-Continual LLM PretrainingJeffrey Li, Mohammadreza Armandpour, Iman Mirzadeh … Fartash FaghriACL
    PDF ↗
  3. 2023
    TiC-CLIP: Continual Training of CLIP ModelsSaurabh Garg, Mehrdad Farajtabar, Hadi Pouransari … Fartash FaghriICLR
    PDF ↗
  4. 2023
    SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial UnderstandingHaoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri … Hadi PouransariCVPR
    PDF ↗
  5. 2022
    Continual Learning Beyond a Single ModelThang Doan, Seyed Iman Mirzadeh, Mehrdad FarajtabarCoLLAs
    PDF ↗
  6. 2022
    Architecture Matters in Continual LearningSeyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin … Mehrdad FarajtabararXiv
    PDF ↗
  7. 2022
    Efficient Continual Learning Ensembles in Neural Network SubspacesT. Doan, Seyed Iman Mirzadeh, Joelle Pineau, Mehrdad FarajtabararXiv
  8. 2021
    Wide Neural Networks Forget Less CatastrophicallySeyed Iman Mirzadeh, Arslan Chaudhry, Yin, Dong … Mehrdad FarajtabarICML · Google (United States)
    PDF ↗
  9. 2021
    Task-agnostic Continual Learning with Hybrid Probabilistic ModelsPolina Kirichenko, Mehrdad Farajtabar, Dushyant Rao … Razvan PascanuarXiv
    PDF ↗
  10. 2020
  11. 2020
    Linear Mode Connectivity in Multitask and Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Görür … Hassan GhasemzadehICLR · Washington State University · Google (United States)
    PDF ↗
  12. 2020
    The Effectiveness of Memory Replay in Large Scale Continual LearningYogesh Balaji, Mehrdad Farajtabar, Dong Yin … Ang LiarXiv
    PDF ↗
  13. 2020
    SOLA: Continual Learning with Second-Order Loss ApproximationDong Yin, Mehrdad Farajtabar, Ang Li … A. MottarXiv
    PDF ↗
  14. 2020
    Understanding the Role of Training Regimes in Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu, Hassan GhasemzadehNeurIPS
    PDF ↗
  15. 2020
    Learning to Incentivize Other Learning AgentsJiachen Yang, Ang Li, Mehrdad Farajtabar … Hongyuan ZhaNeurIPS · Georgia Institute of Technology · Google (United States)
    PDF ↗
  16. 2020
    Dropout as an Implicit Gating Mechanism For Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Hassan GhasemzadehCVPR · Washington State University · Google (United States)
    PDF ↗
  17. 2019
    Orthogonal Gradient Descent for Continual LearningMehrdad Farajtabar, Navid Azizan, A. Mott, Ang LiAISTATS · Google (United States)
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.