Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

46 papers of 8,653Sort Recent · Most cited
  1. 2017
    Lifelong Generative ModelingJason Ramapuram, Magda Gregorová, Alexandros KalousisNeurocomputing · University of Geneva · HES-SO University of Applied Sciences and Arts Western Switzerland
    PDF ↗
  2. 2017
    Using Task Descriptions in Lifelong Machine Learning for Improved Performance and Zero-Shot TransferMohammad Rostami, David Isele, Eric EatonJournal of Artificial Intelligence Research · California University of Pennsylvania
    PDF ↗
  3. 2017
    Incremental Learning Through Deep AdaptationAmir Rosenfeld, John K. TsotsosTPAMI · York University
    PDF ↗
  4. 2017PDF ↗
  5. 2017
    Gradual Tuning: a better way of Fine Tuning the parameters of a Deep Neural NetworkGuglielmo Montone, J. Kevin Ο’Regan, Alexander V. TerekhovarXiv
    PDF ↗
  6. 2017
    Block Neural Network Avoids Catastrophic Forgetting When Learning Multiple TaskGuglielmo Montone, J. Kevin Ο’Regan, Alexander V. TerekhovarXiv
    PDF ↗
  7. 2017
    Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networksRoby Velez, Jeff ClunePLOS · University of Wyoming · Uber AI (United States)
    PDF ↗
  8. 2017
    ASP: Learning to Forget With Adaptive Synaptic Plasticity in Spiking Neural NetworksPriyadarshini Panda, Jason M. Allred, Shriram Ramanathan, Kaushik RoyIEEE Journal on Emerging and Selected Topics in Circuits… · Purdue University West Lafayette
    PDF ↗
  9. 2017
    New Class Adaptation Via Instance Generation in One-Pass Class Incremental LearningYue Zhu, Kai Ming Ting, Zhi‐Hua ZhouICDM · Nanjing University · Federation University
  10. 2017PDF ↗
  11. 2017
    Incremental Learning of Object Detectors without Catastrophic ForgettingKonstantin Shmelkov, Cordelia Schmid, Karteek AlahariICCV · Institut polytechnique de Grenoble · Centre National de la Recherche Scientifique · +3
    PDF ↗
  12. 2017
    Encoder Based Lifelong LearningAmal Rannen, Rahaf Aljundi, Matthew B. Blaschko, Tinne TuytelaarsICCV · IMEC · KU Leuven
    PDF ↗
  13. 2017
    Capacity of Neural Networks for Lifelong Learning of Composable TasksLeslie G. ValiantIEEE 58th Annual Symposium on Foundations of Computer Sci… · Harvard University
  14. 2017
    Lifelong learning of human actions with deep neural network self-organizationGerman I. Parisi, Jun Tani, Cornelius Weber, Stefan WermterNeural Networks · Universität Hamburg · Hamburg University of Technology · +1
  15. 2017
    Habituation based synaptic plasticity and organismic learning in a quantum perovskiteFan Zuo, Priyadarshini Panda, Michele Kotiuga … Shriram RamanathanNature Communications · Purdue University West Lafayette · Rutgers, The State University of New Jersey · +3
  16. 2017
    Dual Track Multimodal Automatic Learning through Human-Robot InteractionShuqiang Jiang, Weiqing Min, Xue Li … Jiaqi ZhouIJCAI · Institute of Computing Technology · University of Chinese Academy of Sciences · +1
  17. 2017PDF ↗
  18. 2017PDF ↗
  19. 2017
    iCaRL: Incremental Classifier and Representation LearningSylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, Christoph H. LampertCVPR · Institute of Science and Technology Austria
    PDF ↗
  20. 2017
    Expert Gate: Lifelong Learning with a Network of ExpertsRahaf Aljundi, Punarjay Chakravarty, Tinne TuytelaarsCVPR · IMEC
    PDF ↗
  21. 2017
    Gradient Episodic Memory for Continual LearningDavid López-Paz, Marc’Aurelio RanzatoNeurIPS · Max Planck Society · Max Planck Innovation · +1
    PDF ↗
  22. 2017PDF ↗
  23. 2017
    Continual Learning with Deep Generative ReplayHanul Shin, Jung Kwon Lee, Jaehong Kim, Jiwon KimNeurIPS · Seoul National University · Samsung (South Korea)
    PDF ↗
  24. 2017
    Continual Learning in Generative Adversarial NetsAri Seff, Alex Beatson, Daniel Suo, Han LiuarXiv · Princeton University
    PDF ↗
  25. 2017
    Streaming Sparse Gaussian Process ApproximationsThang D. Bui, Cuong V. Nguyen, Richard E. TurnerNeurIPS · University of Cambridge
    PDF ↗
  26. 2017PDF ↗
  27. 2017
    A Strategy for an Uncompromising Incremental LearnerRagav Venkatesan, Hemanth Venkateswara, Sethuraman Panchanathan, Baoxin LiarXiv
    PDF ↗
  28. 2017
    Avoiding Catastrophic Forgetting.Michael E. HasselmoTrends in Cognitive Sciences · Boston University
  29. 2017PDF ↗
  30. 2017
    Overcoming Catastrophic Forgetting by Incremental Moment MatchingSang-Woo Lee, Jin-Hwa Kim, Jae-Hyun Jun … Byoung‐Tak ZhangNeurIPS · Seoul National University · Naver (South Korea)
    PDF ↗
  31. 2017
    Overcoming catastrophic forgetting in neural networksJames Kirkpatrick, Razvan Pascanu, Neil C. Rabinowitz … Raia HadsellPNAS · Google DeepMind (United Kingdom) · Imperial College London
    PDF ↗
  32. 2017
    Continual Learning Through Synaptic IntelligenceFriedemann Zenke, Ben Poole, S. GanguliICML
  33. 2017
    Improved multitask learning through synaptic intelligenceFriedemann Zenke, Ben Poole, Surya GanguliarXiv · Stanford University
    PDF ↗
  34. 2017
    Generative and Discriminative Text Classification with Recurrent Neural NetworksDani Yogatama, Chris Dyer, Ling Wang, Phil BlunsomarXiv · Baidu (China) · Carnegie Mellon University · +1
    PDF ↗
  35. 2017
    Meta NetworksTsendsuren Munkhdalai, Hong YuICML
    PDF ↗
  36. 2017
    A Deep Hierarchical Approach to Lifelong Learning in MinecraftChen Tessler, Shahar Givony, Tom Zahavy … Shie MannorAAAI · Technion – Israel Institute of Technology
    PDF ↗
  37. 2017
    Transfer of Knowledge through Collective LearningMohammad RostamiAAAI · California University of Pennsylvania
  38. 2017
    PathNet: Evolution Channels Gradient Descent in Super Neural NetworksChrisantha Fernando, Dylan Banarse, Charles Blundell … Daan WierstraarXiv
    PDF ↗
  39. 2017
    Neurogenesis-Inspired Dictionary Learning: Online Model Adaption in a Changing WorldSahil Garg, Irina Rish, Guillermo Cecchi, Aurélie LozanoIJCAI
    PDF ↗
  40. 2017
    A Joint Many-Task Model: Growing a Neural Network for Multiple NLP TasksKazuma Hashimoto, Caiming Xiong, Yoshimasa Tsuruoka, Richard SocherEMNLP · Salesforce (United States) · The University of Tokyo
    PDF ↗
  41. 2017
    Lifelong Machine LearningZhiyuan Chen, Bing LiuMachine Learning · Google (United States) · University of Illinois Chicago
  42. 2017
    Lifelong Learning CRF for Supervised Aspect ExtractionLei Shu, Hu Xu, Bing LiuACL · University of Illinois Chicago
    PDF ↗
  43. 2017
    Continual LearningClaude Sammut, Geoffrey I. WebbEncyclopedia of Machine Learning and Data Mining · UNSW Sydney · Monash University
  44. 2017
    Continual and One-Shot Learning Through Neural Networks with Dynamic External MemoryBenno Lüders, Mikkel Schläger, Aleksandra Korach, Sebastian RisiSpringer LNCS · IT University of Copenhagen
  45. 2017
    Selective further learning of hybrid ensemble for class imbalanced increment learningMinlong Lin, Ke Tang, HeFei, AnHui 230027, China, Springfield, MO 65801-2604, USABig Data and Information Analytics · University of Science and Technology of China
  46. 2017
    Differentiable Programs with Neural LibrariesAlexander L. Gaunt, Marc Brockschmidt, Nate Kushman, Daniel TarlowICML · Microsoft (United States)
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.