Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

15 papers of 11,817Sort Recent · Most cited
  1. 2025
    Thousand-Brains Systems: Sensorimotor Intelligence for Rapid, Robust Learning and InferenceNiels Leadholm, Viviane Clay, Scott G. Knudstrup … Jeff HawkinsNeural Computation
    PDF ↗
  2. 2025
    Improving Recall in Sparse Associative Memories That Use NeurogenesisKaty Warr, J. Hare, David ThomasNeural Computation
  3. 2024
    Sequential Learning in the Dense Associative MemoryHayden McAlister, Anthony Robins, Lech SzymanskiNeural Computation
    PDF ↗
  4. 2024
    Hebbian Descent: A Unified View on Log-Likelihood LearningJan Melchior, Robin Schiewer, Laurenz WiskottNeural Computation
  5. 2022
    Dynamic Consolidation for Continual LearningHang Li, Chen Ma, Xi Chen, Xue LiuNeural Computation · McGill University · City University of Hong Kong
  6. 2021
    Replay in Deep Learning: Current Approaches and Missing Biological ElementsTyler L. Hayes, Giri P. Krishnan, Maxim Bazhenov … Christopher KananNeural Computation · Rochester Institute of Technology · University of California San Diego · +5
    PDF ↗
  7. 2020
    Task-Agnostic Continual Learning Using Online Variational Bayes With Fixed-Point UpdatesChen Zeno, Itay Golan, Elad Hoffer, Daniel SoudryNeural Computation · Technion – Israel Institute of Technology · Itamar Medical (Israel)
    PDF ↗
  8. 2020
    Artificial Neural Variability for Deep Learning: On Overfitting, Noise Memorization, and Catastrophic ForgettingZeke Xie, Fengxiang He, Shaopeng Fu … Masashi SugiyamaNeural Computation · RIKEN Center for Advanced Intelligence Project · The University of Tokyo · +1
    PDF ↗
  9. 2019
    Toward Training Recurrent Neural Networks for Lifelong LearningShagun Sodhani, Sarath Chandar, Yoshua BengioNeural Computation · Université de Montréal
  10. 2019
    Adversarial Feature Alignment: Avoid Catastrophic Forgetting in Incremental Task Lifelong LearningXin Yao, Tianchi Huang, Chenglei Wu … Lifeng SunNeural Computation · Tsinghua University
    PDF ↗
  11. 2019
    On Training Recurrent Neural Networks for Lifelong LearningShagun Sodhani, Sarath Chandar, Yoshua BengioNeural Computation
    PDF ↗
  12. 2016
  13. 2011
  14. 2006
    Class-Incremental Generalized Discriminant AnalysisWenming ZhengNeural Computation · Southeast University
  15. 2002
    Using Noise to Compute Error Surfaces in Connectionist Networks: A Novel Means of Reducing Catastrophic ForgettingRobert M. French, Nick ChaterNeural Computation · University of Liège · University of Warwick
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.