Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

319 papers of 8,653 · showing 201–250Sort Recent · Most cited
  1. 2019
    Continual Learning with Self-Organizing MapsPouya Bashivan, Martin Schrimpf, Robert Ajemian … Yuhai TuarXiv · Massachusetts Institute of Technology
    PDF ↗
  2. 2019
    Unsupervised Learning to Overcome Catastrophic Forgetting in Neural NetworksIrene Muñoz-Martín, S. Bianchi, Giacomo Pedretti … Daniele IelminiIEEE Journal on Exploratory Solid-State Computational Dev… · IBM Research - Almaden
  3. 2019
    Continual Learning for Anomaly Detection with Variational AutoencoderFelix Wiewel, Bin YangICASSP · University of Stuttgart
  4. 2019
    Parameter Uncertainty for End-to-end Speech RecognitionStefan Braun, Shih‐Chii LiuICASSP · SIB Swiss Institute of Bioinformatics · University of Zurich · +1
  5. 2019
    A Multi-Task Learning Framework for Overcoming the Catastrophic Forgetting in Automatic Speech RecognitionJiabin Xue, Jiqing Han, Tieran Zheng … Jiaxing GuoarXiv · Harbin Institute of Technology
    PDF ↗
  6. 2019
    Three scenarios for continual learningGido M. van de Ven, Andreas S. ToliasNeurIPS
    PDF ↗
  7. 2019
  8. 2019
    Continuous Learning in Single-Incremental-Task ScenariosDavide Maltoni, Vincenzo LomonacoNeural Networks · University of Bologna
    PDF ↗
  9. 2019PDF ↗
  10. 2019
    M2KD: Multi-model and Multi-level Knowledge Distillation for Incremental LearningPeng Zhou, Long Mai, Jianming Zhang … Larry S. DavisarXiv
    PDF ↗
  11. 2019
    Robust High Dimensional Stream Classification with Novel Class DetectionZhuoyi Wang, Zelun Kong, Swarup Changra … Latifur KhanICDE · The University of Texas at Dallas
  12. 2019
    Incremental Learning of Bayesian Networks from Concept-Drift DataHaibo YuIEEE 4th International Conference on Cloud Computing and… · North China Electric Power University · China Electric Power Research Institute
  13. 2019PDF ↗
  14. 2019
    Incremental learning with a homeostatic self-organizing neural modelAlexander GepperthNeural Computing and Applications · Fulda University of Applied Sciences
  15. 2019
    Deep Convolutional Spiking Neural Networks for Image ClassificationRuthvik Vaila, John Chiasson, Vishal SaxenaarXiv
    PDF ↗
  16. 2019
    Efficient Incremental Learning for Mobile Object DetectionDawei Li, Şerafettin Taşcı, Shalini Ghosh … Larry HeckarXiv · Samsung (United States) · Research!America (United States) · +3
    PDF ↗
  17. 2019
    Signal Conditioning for Learning in the WildAyon Borthakur, Thomas A. ClelandNeuro Inspired Computational Elements Workshop · Cornell University
    PDF ↗
  18. 2019
  19. 2019
    Gradient based sample selection for online continual learningRahaf Aljundi, Min Lin, Baptiste Goujaud, Yoshua BengioNeurIPS · KU Leuven · National University of Singapore · +1
    PDF ↗
  20. 2019
    Online continual learning with no task boundariesRahaf Aljundi, Min Lin, Baptiste Goujaud, Yoshua BengioarXiv
  21. 2019PDF ↗
  22. 2019
    Continual Learning in PracticeTom Diethe, Tom Borchert, Eno Thereska … Neil D. LawrenceNeurIPS · Amazon (Germany)
    PDF ↗
  23. 2019
    Affinity Regularized Non-Negative Matrix Factorization for Lifelong Topic ModelingYong Chen, Junjie Wu, Jianying Lin … Zhiwen YeTKDE · Beihang University
  24. 2019
    Continual Learning via Neural PruningSiavash Golkar, M. Kagan, Kyunghyun ChoarXiv
    PDF ↗
  25. 2019
    Continual Learning Using World Models for Pseudo-RehearsalNicholas A. Ketz, Soheil Kolouri, Praveen K. PillyPreprint
  26. 2019
    Using World Models for Pseudo-Rehearsal in Continual LearningNicholas Ketz, Soheil Kolouri, Praveen K. PillyarXiv · HRL Laboratories (United States)
    PDF ↗
  27. 2019
    Attention-Based Structural-PlasticitySoheil Kolouri, Nicholas Ketz, Xinyun Zou … Praveen K. PillyarXiv · HRL Laboratories (United States)
    PDF ↗
  28. 2019
    Design of Hardware-Friendly Memory Enhanced Neural NetworksAnn Franchesca Laguna, Michael Niemier, Xiaobo Sharon HuDesign, Automation & Test in Europe Conference &… · University of Notre Dame
  29. 2019
    Fast event-driven incremental learning of hand symbolsIulia Alexandra Lungu, Shih‐Chii Liu, Tobi DelbrückIEEE International Conference on Artificial Intelligence… · SIB Swiss Institute of Bioinformatics · University of Zurich · +1
  30. 2019
    Task-Based Neuromodulation Architecture for Lifelong LearningAnurag Daram, Dhireesha Kudithipudi, Ángel Yanguas-GilInternational Symposium on Quality Electronic Design (ISQED) · Rochester Institute of Technology · Argonne National Laboratory
  31. 2019
    On Tiny Episodic Memories in Continual LearningArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … M. RanzatoPreprint
  32. 2019
    Continual Learning with Tiny Episodic MemoriesArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … Marc’Aurelio RanzatoarXiv · University of Oxford
    PDF ↗
  33. 2019
    Hierarchical Lifelong Learning by Sharing Representations and Integrating HypothesisTong Zhang, Guoxi Su, Chunmei Qing … Xiaofen XingIEEE Transactions · South China University of Technology
  34. 2019
    ORACLE: Order Robust Adaptive Continual LEarningJaehong Yoon, Saehoon Kim, Eunho Yang, Sung Ju HwangarXiv
  35. 2019
    Online Meta-LearningChelsea Finn, Aravind Rajeswaran, Sham M. Kakade, Sergey LevineICML · Stanford University · University of Washington · +3
    PDF ↗
  36. 2019
    Generative Memory for Lifelong Reinforcement LearningAswin Raghavan, Jesse Hostetler, Sek ChaiarXiv
    PDF ↗
  37. 2019
    Adaptive Masked Weight Imprinting for Few-Shot SegmentationMennatullah Siam, Boris N. Oreshkin, Martin JägersandarXiv · University of Alberta
    PDF ↗
  38. 2019
    A Unifying Bayesian View of Continual LearningSebastian Farquhar, Yarin GalNeurIPS · University of Oxford
    PDF ↗
  39. 2019
    Differentially Private Continual LearningSebastian Farquhar, Yarin GalarXiv · University of Oxford
    PDF ↗
  40. 2019PDF ↗
  41. 2019
    Incremental Reinforcement Learning With Prioritized Sweeping for Dynamic EnvironmentsZhi Wang, Chunlin Chen, Han‐Xiong Li … Tzyh‐Jong TarnIEEE/ASME Transactions on Mechatronics · Nanjing University · Central South University · +3
  42. 2019
    Superposition of Many Models into OneBrian Cheung, A. L. Terekhov, Yubei Chen … Bruno A. OlshausenNeurIPS · University of California, Berkeley
    PDF ↗
  43. 2019
  44. 2019
    EILearn: Learning Incrementally Using Previous Knowledge Obtained From an Ensemble of ClassifiersShivang Agarwal, C. Ravindranath Chowdary, Shripriya MaheshwariarXiv
    PDF ↗
  45. 2019PDF ↗
  46. 2019
    Policy Consolidation for Continual Reinforcement LearningChristos Kaplanis, Murray Shanahan, Claudia ClopathICML · Imperial College London
    PDF ↗
  47. 2019
    Learning and Evaluating General Linguistic IntelligenceDani Yogatama, Cyprien de Masson d’Autume, Jerome T. Connor … Phil BlunsomarXiv · Google (United States)
    PDF ↗
  48. 2019
    Functional Regularisation for Continual Learning using Gaussian ProcessesMichalis K. Titsias, Jonathan Schwarz, Alexander Matthews … Yee Whye TehICLR · Google (United States)
    PDF ↗
  49. 2019
    Functional Regularisation for Continual LearningMichalis K. Titsias, Jonathan Schwarz, A. G. Matthews … Y. TehPreprint
  50. 2019PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.