Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

221 papers of 8,653 · showing 151–200Sort Recent · Most cited
  1. 2019
    A Multi-Task Learning Framework for Overcoming the Catastrophic Forgetting in Automatic Speech RecognitionJiabin Xue, Jiqing Han, Tieran Zheng … Jiaxing GuoarXiv · Harbin Institute of Technology
    PDF ↗
  2. 2019
    Three scenarios for continual learningGido M. van de Ven, Andreas S. ToliasNeurIPS
    PDF ↗
  3. 2019
    Continuous Learning in Single-Incremental-Task ScenariosDavide Maltoni, Vincenzo LomonacoNeural Networks · University of Bologna
    PDF ↗
  4. 2019
    M2KD: Multi-model and Multi-level Knowledge Distillation for Incremental LearningPeng Zhou, Long Mai, Jianming Zhang … Larry S. DavisarXiv
    PDF ↗
  5. 2019
    Robust High Dimensional Stream Classification with Novel Class DetectionZhuoyi Wang, Zelun Kong, Swarup Changra … Latifur KhanICDE · The University of Texas at Dallas
  6. 2019PDF ↗
  7. 2019
    Efficient Incremental Learning for Mobile Object DetectionDawei Li, Şerafettin Taşcı, Shalini Ghosh … Larry HeckarXiv · Samsung (United States) · Research!America (United States) · +3
    PDF ↗
  8. 2019
    Gradient based sample selection for online continual learningRahaf Aljundi, Min Lin, Baptiste Goujaud, Yoshua BengioNeurIPS · KU Leuven · National University of Singapore · +1
    PDF ↗
  9. 2019PDF ↗
  10. 2019
    Continual Learning in PracticeTom Diethe, Tom Borchert, Eno Thereska … Neil D. LawrenceNeurIPS · Amazon (Germany)
    PDF ↗
  11. 2019
    Affinity Regularized Non-Negative Matrix Factorization for Lifelong Topic ModelingYong Chen, Junjie Wu, Jianying Lin … Zhiwen YeTKDE · Beihang University
  12. 2019
    Continual Learning via Neural PruningSiavash Golkar, M. Kagan, Kyunghyun ChoarXiv
    PDF ↗
  13. 2019
    Using World Models for Pseudo-Rehearsal in Continual LearningNicholas Ketz, Soheil Kolouri, Praveen K. PillyarXiv · HRL Laboratories (United States)
    PDF ↗
  14. 2019
    Attention-Based Structural-PlasticitySoheil Kolouri, Nicholas Ketz, Xinyun Zou … Praveen K. PillyarXiv · HRL Laboratories (United States)
    PDF ↗
  15. 2019
    Design of Hardware-Friendly Memory Enhanced Neural NetworksAnn Franchesca Laguna, Michael Niemier, Xiaobo Sharon HuDesign, Automation & Test in Europe Conference &… · University of Notre Dame
  16. 2019
    Fast event-driven incremental learning of hand symbolsIulia Alexandra Lungu, Shih‐Chii Liu, Tobi DelbrückIEEE International Conference on Artificial Intelligence… · SIB Swiss Institute of Bioinformatics · University of Zurich · +1
  17. 2019
    Task-Based Neuromodulation Architecture for Lifelong LearningAnurag Daram, Dhireesha Kudithipudi, Ángel Yanguas-GilInternational Symposium on Quality Electronic Design (ISQED) · Rochester Institute of Technology · Argonne National Laboratory
  18. 2019
    On Tiny Episodic Memories in Continual LearningArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … M. RanzatoPreprint
  19. 2019
    Continual Learning with Tiny Episodic MemoriesArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … Marc’Aurelio RanzatoarXiv · University of Oxford
    PDF ↗
  20. 2019
    Hierarchical Lifelong Learning by Sharing Representations and Integrating HypothesisTong Zhang, Guoxi Su, Chunmei Qing … Xiaofen XingIEEE Transactions · South China University of Technology
  21. 2019
    Online Meta-LearningChelsea Finn, Aravind Rajeswaran, Sham M. Kakade, Sergey LevineICML · Stanford University · University of Washington · +3
    PDF ↗
  22. 2019
    Generative Memory for Lifelong Reinforcement LearningAswin Raghavan, Jesse Hostetler, Sek ChaiarXiv
    PDF ↗
  23. 2019
    Adaptive Masked Weight Imprinting for Few-Shot SegmentationMennatullah Siam, Boris N. Oreshkin, Martin JägersandarXiv · University of Alberta
    PDF ↗
  24. 2019
    A Unifying Bayesian View of Continual LearningSebastian Farquhar, Yarin GalNeurIPS · University of Oxford
    PDF ↗
  25. 2019
    Differentially Private Continual LearningSebastian Farquhar, Yarin GalarXiv · University of Oxford
    PDF ↗
  26. 2019
    Incremental Reinforcement Learning With Prioritized Sweeping for Dynamic EnvironmentsZhi Wang, Chunlin Chen, Han‐Xiong Li … Tzyh‐Jong TarnIEEE/ASME Transactions on Mechatronics · Nanjing University · Central South University · +3
  27. 2019
    Superposition of Many Models into OneBrian Cheung, A. L. Terekhov, Yubei Chen … Bruno A. OlshausenNeurIPS · University of California, Berkeley
    PDF ↗
  28. 2019
    EILearn: Learning Incrementally Using Previous Knowledge Obtained From an Ensemble of ClassifiersShivang Agarwal, C. Ravindranath Chowdary, Shripriya MaheshwariarXiv
    PDF ↗
  29. 2019PDF ↗
  30. 2019
    Policy Consolidation for Continual Reinforcement LearningChristos Kaplanis, Murray Shanahan, Claudia ClopathICML · Imperial College London
    PDF ↗
  31. 2019
    Learning and Evaluating General Linguistic IntelligenceDani Yogatama, Cyprien de Masson d’Autume, Jerome T. Connor … Phil BlunsomarXiv · Google (United States)
    PDF ↗
  32. 2019
    Functional Regularisation for Continual Learning using Gaussian ProcessesMichalis K. Titsias, Jonathan Schwarz, Alexander Matthews … Yee Whye TehICLR · Google (United States)
    PDF ↗
  33. 2019PDF ↗
  34. 2019
    Incremental Reading for Question AnsweringSamira Abnar, Tania Bedrax-Weiss, Tom Kwiatkowski, William W. CohenarXiv · University of Amsterdam · Google (United States)
    PDF ↗
  35. 2019
    Task representations in neural networks trained to perform many cognitive tasksGuangyu Robert Yang, Madhura R. Joglekar, Hui Song … Xiao‐Jing WangNature Neuroscience · New York University · Columbia University · +5
  36. 2019
    Continual Learning with Neural Networks: A ReviewAbhijeet Awasthi, Sunita SarawagiACM India Joint International Conference on Data Science… · Indian Institute of Technology Bombay
  37. 2019
    Sentence Embedding Alignment for Lifelong Relation ExtractionHongfei Wang, Wenhan Xiong, Mo Yu … William Yang WangNAACL · University of California, Santa Barbara
    PDF ↗
  38. 2019
    Overcoming Catastrophic Forgetting During Domain Adaptation of Neural Machine TranslationBrian J. Thompson, Jeremy Gwinnup, Huda Khayrallah … Philipp KoehnNAACL · Johns Hopkins University
  39. 2019
    An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language ModelsAlexandra Chronopoulou, Christos Baziotis, Alexandros PotamianosNAACL · National Technical University of Athens
    PDF ↗
  40. 2019
    Revisiting Distillation and Incremental Classifier LearningKhurram Javed, Faisal ShafaitSpringer LNCS · National University of Sciences and Technology
    PDF ↗
  41. 2019
    An Incremental Construction of Deep Neuro Fuzzy System for Continual Learning of Nonstationary Data StreamsMahardhika Pratama, Witold Pedrycz, Geoffrey I. WebbIEEE Transactions · Nanyang Technological University · University of Alberta · +1
    PDF ↗
  42. 2019
    Psycholinguistics Meets Continual Learning: Measuring Catastrophic Forgetting in Visual Question AnsweringClaudio Greco, Barbara Plank, Raquel Fernández, Raffaella BernardiACL · University of Trento · IT University of Copenhagen · +1
    PDF ↗
  43. 2019
    Adding New Tasks to a Single Network with Weight Trasformations using Binary MasksMassimiliano Mancini, Elisa Ricci, Barbara Caputo, Samuel Rota BulòSpringer LNCS · Fondazione Bruno Kessler · Sapienza University of Rome · +2
    PDF ↗
  44. 2019
    Continual and Multi-Task Architecture SearchRamakanth Pasunuru, Mohit BansalACL · University of North Carolina at Chapel Hill · University of North Carolina Health Care
    PDF ↗
  45. 2019
    Continual Learning for Sentence Representations Using ConceptorsTianlin Liu, Lyle Ungar, João SedocNAACL · Constructor University · University of Pennsylvania
    PDF ↗
  46. 2019
    A Progressive Model to Enable Continual Learning for Semantic Slot FillingYilin Shen, Xiangyu Zeng, Hongxia JinEMNLP · Samsung (South Korea) · Samsung (United States) · +1
  47. 2019
    Meta-Learning Improves Lifelong Relation ExtractionAbiola Obamuyide, Andreas VlachosWorkshop on Representation Learning for NLP (RepL4NLP-2019) · University of Cambridge · PRG S&Tech (South Korea) · +1
  48. 2019
    Incremental Learning from Scratch for Task-Oriented Dialogue SystemsWeikang Wang, Jiajun Zhang, Qian Li … Zhifei LiACL · Shandong Institute of Automation · Institute of Automation · +3
    PDF ↗
  49. 2019
    Continuous Learning for Large-scale Personalized Domain ClassificationHan Li, Jihwan Lee, Sidharth Mudgal … Young‐Bum KimNAACL · University of Wisconsin–Madison · Amazon (Germany)
    PDF ↗
  50. 2019
    Memorized Variational Continual Learning for Dirichlet Process MixturesYang Yang, Bo Chen, Hongwei LiuIEEE Access · Xidian University
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.