Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

490 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2019
    Spiking Neural Predictive Coding for Continual Learning from Data StreamsAlexander G. OrorbiaNeurocomputing · Rochester Institute of Technology
    PDF ↗
  2. 2019
    Unified Probabilistic Deep Continual Learning through Generative Replay and Open Set RecognitionMartin Mundt, Iuliia Pliushch, Sagnik Majumder … Visvanathan RameshJournal of Imaging · Goethe University Frankfurt · The University of Texas at Austin · +1
    PDF ↗
  3. 2019
    Online Gaussian Process State-space Model: Learning and Planning for Partially Observable Dynamical SystemsSoon-Seo Park, Young-Jin Park, Young-Jae Min, Han‐Lim ChoiInternational Journal of Control Automation and Systems · NCSOFT (South Korea) · NAVER Cloud (South Korea) · +4
    PDF ↗
  4. 2019
    Lifelong Neural Predictive Coding: Learning Cumulatively Online without ForgettingAlex Ororbia, Ankur Mali, C Lee Giles, Daniel KiferNeurIPS
    PDF ↗
  5. 2019
    Incremental classifier learning based on PEDCC-loss and cosine distanceQiuyu Zhu, Zikuang He, Xin YeMultimedia Tools and Applications · Shanghai University
    PDF ↗
  6. 2019
    SpaRCe: Improved Learning of Reservoir Computing Systems Through Sparse RepresentationsLuca Manneschi, Andrew C. Lin, Eleni VasilakiTNNLS · University of Sheffield
    PDF ↗
  7. 2019
    Unsupervised Progressive Learning and the STAM ArchitectureJames Smith, Cameron Taylor, Seth Baer, Constantine DovrolisIJCAI · Georgia Institute of Technology
    PDF ↗
  8. 2019
    S-TRIGGER: Continual State Representation Learning via Self-Triggered Generative ReplayHugo Caselles-Dupré, Michael Garcia-Ortiz, David FilliatIEEE International Joint Conference on Neural Network · Institut national de recherche en sciences et technologies du numérique · École Nationale Supérieure de Techniques Avancées · +1
    PDF ↗
  9. 2019
    REFIT: A Unified Watermark Removal Framework For Deep Learning Systems With Limited DataXinyun Chen, Wenxiao Wang, Chris Bender … Dawn SongACM Asia Conference on Computer and Communications Security · University of California, Berkeley · Tsinghua University · +2
    PDF ↗
  10. 2019
    Using Hindsight to Anchor Past Knowledge in Continual LearningArslan Chaudhry, Albert Gordo, Puneet K. Dokania … David López-PazAAAI · University of Oxford · Meta (Israel)
    PDF ↗
  11. 2019
    Gated Linear NetworksJoel Veness, Tor Lattimore, David Budden … Marcus HütterAAAI · Google DeepMind (United Kingdom)
    PDF ↗
  12. 2019
    Overcoming Long-Term Catastrophic Forgetting Through Adversarial Neural Pruning and Synaptic ConsolidationJian Peng, Bo Tang, Hao Jiang … Haifeng LiTNNLS · Central South University · Mississippi State University · +3
    PDF ↗
  13. 2019
    Knowledge Distillation for Incremental Learning in Semantic SegmentationUmberto Michieli, Pietro ZanuttighComputer Vision and Image Understanding · University of Padua
    PDF ↗
  14. 2019
    A Continual Learning Survey: Defying Forgetting in Classification TasksMatthias Delange, Rahaf Aljundi, Marc Masana … Tinne TuytelaarsTPAMI · Computer Vision Center · Huawei Technologies (Canada)
    PDF ↗
  15. 2019
    Self-Reinforcing Unsupervised MatchingJiang Lu, Lei Li, Changshui ZhangTPAMI · Peking University · Huazhong University of Science and Technology · +1
    PDF ↗
  16. 2019
    Measuring Catastrophic Forgetting in Visual Question AnsweringClaudio Greco, Barbara Plank, Raquel Fernández, Raffaella BernardiSpringer LNCS · University of Trento · IT University of Copenhagen · +1
  17. 2019
    Representative Task Self-Selection for Flexible Clustered Lifelong LearningGan Sun, Yang Cong, Qianqian Wang … Yun FuTNNLS · Northeastern University · Shenyang Institute of Automation · +3
    PDF ↗
  18. 2019
    Better Knowledge Retention through Metric LearningKe Li, Shichong Peng, Kailas Vodrahalli, Jitendra MalikarXiv
    PDF ↗
  19. 2019
    Incremental Learning Using a Grow-and-Prune Paradigm With Efficient Neural NetworksXiaoliang Dai, Hongxu Yin, Niraj K. JhaIEEE Transactions · Princeton University
    PDF ↗
  20. 2019
    Lifelong learning for text retrieval and recognition in historical handwritten document collectionsLambert SchomakerSeries in machine perception and artificial intelligence · University of Groningen
    PDF ↗
  21. 2019
    Latent Replay for Real-Time Continual LearningLorenzo Pellegrini, Gabriele Graffieti, Vincenzo Lomonaco, Davide MaltoniIROS · University of Bologna
    PDF ↗
  22. 2019
    Design of Flipped Classroom Model for a Computer-Aided Structural Analysis Design and Experimentation CourseRupa Purasinghe, Akshay PatelASEE Annual Conference & Exposition Proceedings · California State University Los Angeles · Pramukhswami Medical College
  23. 2019
    Continual Learning Using Bayesian Neural NetworksHonglin Li, Payam Barnaghi, Shirin Enshaeifar, Frieder GanzTNNLS · University of Surrey · UK Dementia Research Institute · +1
    PDF ↗
  24. 2019
    Incremental Concept Learning via Online Generative Memory RecallHuaiyu Li, Weiming Dong, Bao-Gang HuTNNLS · Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence · +2
    PDF ↗
  25. 2019
    Motion Planning Networks: Bridging the Gap Between Learning-Based and Classical Motion PlannersAhmed H. Qureshi, Yinglong Miao, Anthony Simeonov, Michael C. YipIEEE Transactions · University of California San Diego · Massachusetts Institute of Technology
    PDF ↗
  26. 2019
    Broad Learning System Based on Maximum Correntropy CriterionYunfei Zheng, Badong Chen, Shiyuan Wang, Weiqun WangTNNLS · Xi'an Jiaotong University · Southwest University · +2
    PDF ↗
  27. 2019
    Forget Me Not: Reducing Catastrophic Forgetting for Domain Adaptation in Reading ComprehensionYing Xu, Xu Zhong, Antonio Jimeno Yepes, Jey Han LauIJCNN · IBM Research - Australia · The University of Melbourne
    PDF ↗
  28. 2019
    Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversionHongxu Yin, Pavlo Molchanov, Jose M. Álvarez … Jan KautzCVPR · Princeton University · University of Illinois Urbana-Champaign
    PDF ↗
  29. 2019
    Maintaining Discrimination and Fairness in Class Incremental LearningBowen Zhao, Xi Xiao, Guojun Gan … Shu‐Tao XiaCVPR · Peng Cheng Laboratory · Tsinghua University
    PDF ↗
  30. 2019
    Lifelong Machine Learning with Deep Streaming Linear Discriminant AnalysisTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology
    PDF ↗
  31. 2019
    Rehearsal-Free Continual Learning over Small Non-I.I.D. BatchesVincenzo Lomonaco, Davide Maltoni, Lorenzo PellegriniCVPR · University of Bologna
    PDF ↗
  32. 2019
    Sequential Mastery of Multiple Visual Tasks: Networks Naturally Learn to Learn and Forget to ForgetGuy Davidson, Michael C. MozerCVPR · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +2
    PDF ↗
  33. 2019
    A distributed incremental update scheme for probability distribution of wind power forecast errorMengshuo Jia, Chen Shen, Zhaojian WangInternational Journal of Electrical Power & Energy Systems · State Nuclear Power Technology Company (China) · Tsinghua University
    PDF ↗
  34. 2019
    On Semi-Supervised Multiple Representation Behavior LearningRuqian Lu, Shengluan HouJournal of Computational Science · Chinese Academy of Sciences · Institute of Computing Technology · +2
    PDF ↗
  35. 2019
    A Story of Two Streams: Reinforcement Learning Models from Human Behavior and NeuropsychiatryBaihan Lin, Guillermo Cecchi, Djallel Bouneffouf … Irina RishAdaptive Agents and Multi-Agents Systems · Columbia University · IBM (United States) · +1
    PDF ↗
  36. 2019
    OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep LearningQi She, Fan Feng, Xinyue Hao … Rosa H. M. ChanICRA · City University of Hong Kong · Tsinghua University · +4
    PDF ↗
  37. 2019
    Sharp Bounds for Genetic Drift in Estimation of Distribution AlgorithmsBenjamin Doerr, Weijie ZhengIEEE Transactions · Centre National de la Recherche Scientifique · École Polytechnique · +4
    PDF ↗
  38. 2019
    Semi-Supervised Learning for Text Classification by Layer PartitioningAlexander Hanbo Li, Abhinav SethyICASSP · Amazon (United States)
    PDF ↗
  39. 2019
    Continual Learning for Infinite Hierarchical Change-Point DetectionPablo Moreno-Muñoz, David Ramírez, Antonio Artés-Rodrı́guezICASSP · Universidad Carlos III de Madrid
    PDF ↗
  40. 2019
    Towards Making the Most of BERT in Neural Machine TranslationJiacheng Yang, Mingxuan Wang, Hao Zhou … Lei LiAAAI · Shanghai Jiao Tong University
    PDF ↗
  41. 2019
    Proximal Distilled Evolutionary Reinforcement LearningCristian Bodnar, Ben Day, Píetro LióAAAI · University of Cambridge
    PDF ↗
  42. 2019
    Just Ask: An Interactive Learning Framework for Vision and Language NavigationTa-Chung Chi, Minmin Shen, Mihail Eric … Dilek Hakkani-TürAAAI · Carnegie Mellon University
    PDF ↗
  43. 2019
    Overcoming Catastrophic Forgetting by Neuron-level Plasticity ControlInyoung Paik, Sangjun Oh, Tae-Yeong Kwak, Injung KimAAAI · Handong Global University
    PDF ↗
  44. 2019
    Generative Continual Concept LearningMohammad Rostami, Soheil Kolouri, Praveen K. Pilly, James L. McClellandAAAI · California University of Pennsylvania · HRL Laboratories (United States) · +1
    PDF ↗
  45. 2019
    DeGAN : Data-Enriching GAN for Retrieving Representative Samples from a Trained ClassifierSravanti Addepalli, Gaurav Kumar Nayak, Anirban Chakraborty, Venkatesh Babu RadhakrishnanAAAI · Indian Institute of Science Bangalore
    PDF ↗
  46. 2019
    Lifelong Learning with a Changing Action SetYash Chandak, Georgios Theocharous, Chris Nota, Philip S. ThomasAAAI · University of Massachusetts Amherst · Adobe Systems (United States)
    PDF ↗
  47. 2019
    Incremental multi-domain learning with network latent tensor factorizationAdrian Bulat, Jean Kossaifi, Georgios Tzimiropoulos, Maja PantićAAAI · Samsung (United States)
    PDF ↗
  48. 2019
    Learning from the Past: Continual Meta-Learning with Bayesian Graph Neural NetworksYadan Luo, Zi Huang, Zheng Zhang … Yang YangAAAI · The University of Queensland · Harbin Institute of Technology · +1
    PDF ↗
  49. 2019
    Gamma-Nets: Generalizing Value Estimation over TimescaleCraig Sherstan, Shibhansh Dohare, James MacGlashan … Patrick M. PilarskiAAAI · University of Alberta
    PDF ↗
  50. 2019
    Rapid online learning and robust recall in a neuromorphic olfactory circuitNabil Imam, Thomas A. ClelandNature Machine Intelligence · Intel (United States) · Cornell University
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.