Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

235 papers of 8,653 · showing 201–235Sort Recent · Most cited
  1. 2020
    Graph-Based Continual LearningBinh Tang, David S. MattesonICLR · Cornell University
    PDF ↗
  2. 2020
    Continual learning in recurrent neural networksBenjamin Ehret, Christian Henning, Maria R. Cervera … B. GreweICLR
  3. 2020
    CPR: Classifier-Projection Regularization for Continual LearningSungmin Cha, Hsiang Hsu, Taebaek Hwang … Taesup MoonICLR
    PDF ↗
  4. 2020
    Continual Learning with Bayesian Neural Networks for Non-Stationary DataRichard Kurle, Botond Cseke, Alexej Klushyn … Stephan GünnemannICLR
  5. 2020
  6. 2018PDF ↗
  7. 2020
    BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong LearningYeming Wen, Dustin Tran, Jimmy BaICLR · University of Toronto · Google (United States)
    PDF ↗
  8. 2020
    A Neural Dirichlet Process Mixture Model for Task-Free Continual LearningSoochan Lee, Junsoo Ha, Dongsu Zhang, Gunhee KimICLR
    PDF ↗
  9. 2020
  10. 2019
    Continual Learning with Adaptive Weights (CLAW)Tameem Adel, Han Zhao, Richard E. TurnerICLR
    PDF ↗
  11. 2019
    Compositional Language Continual LearningYuanpeng Li, Liang Zhao, Kenneth Ward Church, Mohamed ElhoseinyICLR
  12. 2019
    LAMOL: LAnguage MOdeling for Lifelong Language LearningFan-Keng Sun, Cheng-Hao Ho, Hung-yi LeeICLR · Massachusetts Institute of Technology · National Taiwan University
    PDF ↗
  13. 2019
    Uncertainty-guided Continual Learning with Bayesian Neural NetworksSayna Ebrahimi, Mohamed Elhoseiny, Trevor Darrell, Marcus RohrbachICLR · University of California, Berkeley · King Abdullah University of Science and Technology · +1
    PDF ↗
  14. 2019
    Continual learning with hypernetworksJohannes von Oswald, Christian Henning, J. Sacramento, B. GreweICLR
    PDF ↗
  15. 2019
    A comprehensive, application-oriented study of catastrophic forgetting in DNNsBenedikt Pfülb, Alexander GepperthICLR · Fulda University of Applied Sciences
    PDF ↗
  16. 2019
    Scalable and Order-robust Continual Learning with Additive Parameter DecompositionJaehong Yoon, Saehoon Kim, Eunho Yang, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology
    PDF ↗
  17. 2019
    Functional Regularisation for Continual Learning using Gaussian ProcessesMichalis K. Titsias, Jonathan Schwarz, Alexander Matthews … Yee Whye TehICLR · Google (United States)
    PDF ↗
  18. 2017
    Variational Continual LearningTurner, RE, Thang D. Bui, Yingzhen Li, Cuong, NguyenICLR · University of Cambridge
    PDF ↗
  19. 2019
    Progressive Memory Banks for Incremental Domain AdaptationNabiha Asghar, Lili Mou, Kira A. Selby … Xin JiangICLR
  20. 2019
  21. 2019
    Deep Online Learning via Meta-Learning: Continual Adaptation for Model-Based RLAnusha Nagabandi, Chelsea Finn, Sergey LevineICLR · University of California, Berkeley
    PDF ↗
  22. 2018
    An Empirical Study of Example Forgetting during Deep Neural Network LearningMariya Toneva, Alessandro Sordoni, Rémi Tachet des Combes … Geoffrey J. GordonICLR · Carnegie Mellon University · Microsoft (United States) · +1
    PDF ↗
  23. 2018
    Efficient Lifelong Learning with A-GEMArslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, Mohamed ElhoseinyICLR
    PDF ↗
  24. 2018
    Learning to Learn without Forgetting By Maximizing Transfer and Minimizing InterferenceMatthew Riemer, Ignacio Cases, Robert Ajemian … Gerald TesauroICLR · IBM (United States) · Stanford University · +2
    PDF ↗
  25. 2018
  26. 2018
    Selfless Sequential LearningRahaf Aljundi, Marcus Rohrbach, Tinne TuytelaarsICLR
    PDF ↗
  27. 2018
    Measuring and regularizing networks in function spaceAri S. Benjamin, David Rolnick, Konrad P. KördingICLR · University of Pennsylvania · Philadelphia University
    PDF ↗
  28. 2018
    Memory-based Parameter AdaptationPablo Sprechmann, Siddhant M. Jayakumar, Jack W. Rae … Charles BlundellICLR · Google (United States)
    PDF ↗
  29. 2018
    Bayesian Incremental Learning for Deep Neural NetworksMax Kochurov, Timur Garipov, Dmitry Podoprikhin … Dmitry VetrovICLR · Skolkovo Institute of Science and Technology · Samsung (South Korea) · +1
    PDF ↗
  30. 2018
  31. 2017
    FearNet: Brain-Inspired Model for Incremental LearningRonald Kemker, Christopher KananICLR
    PDF ↗
  32. 2017
    Modular Continual Learning in a Unified Visual EnvironmentKevin Feigelis, Blue Sheffer, Daniel YaminsICLR · Rutgers, The State University of New Jersey · Stanford University
    PDF ↗
  33. 2017
    Lifelong Learning with Dynamically Expandable NetworksJaehong Yoon, Eunho Yang, Jeongtae Lee, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology
    PDF ↗
  34. 2016
    Net2Net: Accelerating Learning via Knowledge TransferTianqi Chen, Ian Goodfellow, Jonathon ShlensICLR · University of Washington · Google (United States)
    PDF ↗
  35. 2013
    An Empirical Investigation of Catastrophic Forgeting in Gradient-Based Neural NetworksIan Goodfellow, Mehdi Mirza, Xiao Da … Yoshua BengioICLR · Département d'Informatique · Université de Montréal · +1
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.