Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

17 papers of 11,817Sort Recent · Most cited
  1. 2026
    Modular Memory is the Key to Continual Learning AgentsVaggelis Dorovatas, M. Schwerin, Andrew D. Bagdanov … Rahaf AljundiarXiv
    PDF ↗
  2. 2023
    Continual Learning: Applications and the Road ForwardEli Verwimp, S. Ben-David, Matthias Bethge … Gido M. van de VenTrans. Mach. Learn. Res.
    PDF ↗
  3. 2023
    How Efficient Are Today’s Continual Learning Algorithms?Md Yousuf Harun, Jhair Gallardo, Tyler L. Hayes, Christopher KananCVPR
    PDF ↗
  4. 2023
    SIESTA: Efficient Online Continual Learning with SleepMd Yousuf Harun, Jhair Gallardo, Tyler L. Hayes … Christopher KananTrans. Mach. Learn. Res.
    PDF ↗
  5. 2022
    System Design for an Integrated Lifelong Reinforcement Learning Agent for Real-Time Strategy GamesIndranil Sur, Zachary Daniels, Abrar Rahman … Aswin RaghavanInternational Conference on AI-ML-Systems · SRI International · American University · +3
    PDF ↗
  6. 2022
    Online Continual Learning for Embedded DevicesTyler L. Hayes, Christopher KananCoLLAs
    PDF ↗
  7. 2021
    Replay in Deep Learning: Current Approaches and Missing Biological ElementsTyler L. Hayes, Giri P. Krishnan, Maxim Bazhenov … Christopher KananNeural Computation · Rochester Institute of Technology · University of California San Diego · +5
    PDF ↗
  8. 2021
    Avalanche: an End-to-End Library for Continual LearningVincenzo Lomonaco, Lorenzo Pellegrini, Andrea Cossu … Davide MaltoniCVPR · University of Pisa · University of Bologna · +12
    PDF ↗
  9. 2021
    Selective Replay Enhances Learning in Online Continual Analogical ReasoningTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology · Cornell University · +1
    PDF ↗
  10. 2021
    Self-Supervised Training Enhances Online Continual LearningGianmarco J Gallardo, Tyler L. Hayes, Christopher KananBMVC
    PDF ↗
  11. 2019
    Lifelong Machine Learning with Deep Streaming Linear Discriminant AnalysisTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology
    PDF ↗
  12. 2020
    Stream-51: Streaming Classification and Novelty Detection from VideosRyne Roady, Tyler L. Hayes, Hitesh Vaidya, Christopher KananCVPR · Rochester Institute of Technology
  13. 2019
    REMIND Your Neural Network to Prevent Catastrophic ForgettingTyler L. Hayes, Kushal Kafle, Robik Shrestha … Christopher KananSpringer LNCS · Rochester Institute of Technology · Adobe Systems (United States) · +2
    PDF ↗
  14. 2020
    RODEO: Replay for Online Object DetectionManoj Acharya, Tyler L. Hayes, Christopher KananBMVC · Rochester Institute of Technology
    PDF ↗
  15. 2018
    Memory Efficient Experience Replay for Streaming LearningTyler L. Hayes, Nathan D. Cahill, Christopher KananICRA · Rochester Institute of Technology
    PDF ↗
  16. 2018
    New Metrics and Experimental Paradigms for Continual LearningTyler L. Hayes, Ronald Kemker, Nathan D. Cahill, Christopher KananCVPR · Rochester Institute of Technology
  17. 2017
    Measuring Catastrophic Forgetting in Neural NetworksRonald Kemker, Marc McClure, Angelina Abitino … Christopher KananAAAI · Rochester Institute of Technology · Swarthmore College
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.