Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

23 papers of 11,817Sort Recent · Most cited
  1. 2019
    Spiking Neural Predictive Coding for Continual Learning from Data StreamsAlexander G. OrorbiaNeurocomputing · Rochester Institute of Technology
    PDF ↗
  2. 2022
    System Design for an Integrated Lifelong Reinforcement Learning Agent for Real-Time Strategy GamesIndranil Sur, Zachary Daniels, Abrar Rahman … Aswin RaghavanInternational Conference on AI-ML-Systems · SRI International · American University · +3
    PDF ↗
  3. 2021
    Reducing Catastrophic Forgetting in Self Organizing Maps with Internally-Induced Generative ReplayHitesh Vaidya, Travis Desell, Alexander G. OrorbiaAAAI · Rochester Institute of Technology
    PDF ↗
  4. 2022
    Unsupervised Continual Learning for Gradually Varying DomainsAbu Md Niamul Taufique, Chowdhury Sadman Jahan, Andreas SavakisCVPR · Rochester Institute of Technology
  5. 2022
    Biological underpinnings for lifelong learning machinesDhireesha Kudithipudi, Mario Aguilar-Simon, Jonathan Babb … Hava T. SiegelmannNature Machine Intelligence · The University of Texas at San Antonio · Intelligent Systems Research (United States) · +24
  6. 2021
    Replay in Deep Learning: Current Approaches and Missing Biological ElementsTyler L. Hayes, Giri P. Krishnan, Maxim Bazhenov … Christopher KananNeural Computation · Rochester Institute of Technology · University of California San Diego · +5
    PDF ↗
  7. 2021
    Continual Competitive Memory: A Neural System for Online Task-Free Lifelong LearningAlexander G. OrorbiaOSF Preprints (OSF Preprints) · Rochester Institute of Technology
    PDF ↗
  8. 2021
    Avalanche: an End-to-End Library for Continual LearningVincenzo Lomonaco, Lorenzo Pellegrini, Andrea Cossu … Davide MaltoniCVPR · University of Pisa · University of Bologna · +12
    PDF ↗
  9. 2021
    Selective Replay Enhances Learning in Online Continual Analogical ReasoningTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology · Cornell University · +1
    PDF ↗
  10. 2021
    A Continual Learning Framework for Uncertainty-Aware Interactive Image SegmentationErvine Zheng, Qi Yu, Rui Li … Anne R. HaakeAAAI · Rochester Institute of Technology
  11. 2020
    A Neural State Pushdown AutomataAnkur Mali, Alexander G. Ororbia, C. Lee GilesIEEE TAI · Pennsylvania State University · Rochester Institute of Technology
    PDF ↗
  12. 2020
    Metaplasticity in Multistate Memristor Synaptic NetworksFatima Tuz Zohora, Abdullah M. Zyarah, Nicholas Soures, Dhireesha KudithipudiInternational Symposium on Circuits and Systems · The University of Texas at San Antonio · Rochester Institute of Technology
    PDF ↗
  13. 2019
    Lifelong Machine Learning with Deep Streaming Linear Discriminant AnalysisTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology
    PDF ↗
  14. 2020
    Stream-51: Streaming Classification and Novelty Detection from VideosRyne Roady, Tyler L. Hayes, Hitesh Vaidya, Christopher KananCVPR · Rochester Institute of Technology
  15. 2018
    Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed RepresentationsAlexander G. Ororbia, Ankur Mali, C. Lee Giles, Daniel KiferTNNLS · Rochester Institute of Technology · Pennsylvania State University
    PDF ↗
  16. 2019
    REMIND Your Neural Network to Prevent Catastrophic ForgettingTyler L. Hayes, Kushal Kafle, Robik Shrestha … Christopher KananSpringer LNCS · Rochester Institute of Technology · Adobe Systems (United States) · +2
    PDF ↗
  17. 2020
    RODEO: Replay for Online Object DetectionManoj Acharya, Tyler L. Hayes, Christopher KananBMVC · Rochester Institute of Technology
    PDF ↗
  18. 2019
    Rethinking Continual Learning for Autonomous Agents and RobotsGerman I. Parisi, Christopher KananarXiv · Universität Hamburg · Rochester Institute of Technology
    PDF ↗
  19. 2018
    Memory Efficient Experience Replay for Streaming LearningTyler L. Hayes, Nathan D. Cahill, Christopher KananICRA · Rochester Institute of Technology
    PDF ↗
  20. 2019
    Task-Based Neuromodulation Architecture for Lifelong LearningAnurag Daram, Dhireesha Kudithipudi, Ángel Yanguas-GilInternational Symposium on Quality Electronic Design (ISQED) · Rochester Institute of Technology · Argonne National Laboratory
  21. 2018
    Clustered Lifelong Learning Via Representative Task SelectionGan Sun, Yang Cong, Yu Kong, Xiaowei XuICDM · University of Chinese Academy of Sciences · Shenyang Institute of Automation · +3
  22. 2018
    New Metrics and Experimental Paradigms for Continual LearningTyler L. Hayes, Ronald Kemker, Nathan D. Cahill, Christopher KananCVPR · Rochester Institute of Technology
  23. 2017
    Measuring Catastrophic Forgetting in Neural NetworksRonald Kemker, Marc McClure, Angelina Abitino … Christopher KananAAAI · Rochester Institute of Technology · Swarthmore College
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.