Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

15 papers of 8,653Sort Recent · Most cited
  1. 2020
    Efficient Continual Learning with Modular Networks and Task-Driven PriorsTom Véniat, Ludovic Denoyer, Marc’Aurelio RanzatoICLR · Meta (United States)
    PDF ↗
  2. 2020
    Reset-Free Lifelong Learning with Skill-Space PlanningKevin Lü, Aditya Grover, Pieter Abbeel, Igor MordatchICLR · University of California, Berkeley · Stanford University · +1
    PDF ↗
  3. 2020
    Generalized Variational Continual LearningNoel Loo, Siddharth Swaroop, Richard E. TurnerICLR · University of Cambridge
    PDF ↗
  4. 2020
    Linear Mode Connectivity in Multitask and Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Görür … Hassan GhasemzadehICLR · Washington State University · Google (United States)
    PDF ↗
  5. 2020
    Remembering for the Right Reasons: Explanations Reduce Catastrophic ForgettingSayna Ebrahimi, S. Petryk, Akash Gokul … Trevor DarrellICLR
    PDF ↗
  6. 2020
    Lifelong Learning of Compositional StructuresJorge A. Mendez, Eric EatonICLR · California University of Pennsylvania · University of Pennsylvania
    PDF ↗
  7. 2020
    Anatomy of Catastrophic Forgetting: Hidden Representations and Task SemanticsVinay Ramasesh, Ethan Dyer, Maithra RaghuICLR · Google (United States) · Cornell University
    PDF ↗
  8. 2020
    Graph-Based Continual LearningBinh Tang, David S. MattesonICLR · Cornell University
    PDF ↗
  9. 2020
    Continual learning in recurrent neural networksBenjamin Ehret, Christian Henning, Maria R. Cervera … B. GreweICLR
  10. 2020
    CPR: Classifier-Projection Regularization for Continual LearningSungmin Cha, Hsiang Hsu, Taebaek Hwang … Taesup MoonICLR
    PDF ↗
  11. 2020
    Continual Learning with Bayesian Neural Networks for Non-Stationary DataRichard Kurle, Botond Cseke, Alexej Klushyn … Stephan GünnemannICLR
  12. 2020
  13. 2020
    BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong LearningYeming Wen, Dustin Tran, Jimmy BaICLR · University of Toronto · Google (United States)
    PDF ↗
  14. 2020
    A Neural Dirichlet Process Mixture Model for Task-Free Continual LearningSoochan Lee, Junsoo Ha, Dongsu Zhang, Gunhee KimICLR
    PDF ↗
  15. 2020
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.