Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

12 papers of 11,817Sort Recent · Most cited
  1. 2022
    Discrete Key-Value BottleneckFrederik Träuble, Anirudh Goyal, Nasim Rahaman … Bernhard SchölkopfICML
    PDF ↗
  2. 2021
    A Consciousness-Inspired Planning Agent for Model-Based Reinforcement LearningMingde Zhao, Zhen Liu, Sitao Luan … Yoshua BengioarXiv · Dalian University of Technology · Université de Montréal · +1
    PDF ↗
  3. 2021
    A Two-Stream Continual Learning System With Variational Domain-Agnostic Feature ReplayQicheng Lao, Xiang Jiang, Mohammad Havaei, Yoshua BengioTNNLS · West China Medical Center of Sichuan University
  4. 2020
    Learning Causal Models OnlineKhurram Javed, Martha White, Yoshua BengioarXiv
    PDF ↗
  5. 2020
    On Catastrophic Interference in Atari 2600 GamesWilliam Fedus, Dibya Ghosh, John D. Martin … Hugo LarochellearXiv
    PDF ↗
  6. 2019
    Toward Training Recurrent Neural Networks for Lifelong LearningShagun Sodhani, Sarath Chandar, Yoshua BengioNeural Computation · Université de Montréal
  7. 2019
    Conditional Computation for Continual LearningMin Lin, Jie Fu, Yoshua BengioarXiv
    PDF ↗
  8. 2019
    Gradient based sample selection for online continual learningRahaf Aljundi, Min Lin, Baptiste Goujaud, Yoshua BengioNeurIPS · KU Leuven · National University of Singapore · +1
    PDF ↗
  9. 2019
    Online continual learning with no task boundariesRahaf Aljundi, Min Lin, Baptiste Goujaud, Yoshua BengioarXiv
  10. 2018
    An Empirical Study of Example Forgetting during Deep Neural Network LearningMariya Toneva, Alessandro Sordoni, Rémi Tachet des Combes … Geoffrey J. GordonICLR · Carnegie Mellon University · Microsoft (United States) · +1
    PDF ↗
  11. 2019
    On Training Recurrent Neural Networks for Lifelong LearningShagun Sodhani, Sarath Chandar, Yoshua BengioNeural Computation
    PDF ↗
  12. 2013
    An Empirical Investigation of Catastrophic Forgeting in Gradient-Based Neural NetworksIan Goodfellow, Mehdi Mirza, Xiao Da … Yoshua BengioICLR · Département d'Informatique · Université de Montréal · +1
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.