Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

89 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2020
    Learning Invariant Representation for Continual LearningGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiyarXiv · Eindhoven University of Technology · University of Twente
    PDF ↗
  2. 2020
    Selective Forgetting of Deep Networks at a Finer Level than SamplesTomohiro Hayase, Suguru Yasutomi, Takashi KatoharXiv
    PDF ↗
  3. 2020
    Consequences of Slow Neural Dynamics for Incremental LearningShima Rahimi Moghaddam, Fanjun Bu, Christopher J. HoneyarXiv
    PDF ↗
  4. 2020
    Association: Remind Your GAN not to ForgetYi Gu, Jie Li, Yuting Gao … Zhang, ZiruiarXiv
    PDF ↗
  5. 2020
    Continual learning with direction-constrained optimizationYunfei Teng, A. Choromańska, Murray CampbellarXiv
  6. 2020
    Lethean Attack: An Online Data Poisoning TechniqueEyal PerryarXiv · Massachusetts Institute of Technology
    PDF ↗
  7. 2020
    Consolidation via Policy Information Regularization in Deep RL for Multi-Agent GamesTyler Malloy, Tim Klinger, Miao Liu … Chris R. SimsarXiv
    PDF ↗
  8. 2020
    Generalized Continual Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramarXiv · Indian Institute of Science Bangalore · Indian Institute of Technology Madras
    PDF ↗
  9. 2020PDF ↗
  10. 2020
    Continual Learning with Deep Artificial NeuronsBlake Camp, Jaya Krishna Mandivarapu, Rolando EstradaarXiv · Georgia State University
    PDF ↗
  11. 2020
    Meta-Learning for Natural Language Understanding under Continual Learning FrameworkJiacheng Wang, Yong Fan, Duo Jiang, Shiqing LiarXiv · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +1
    PDF ↗
  12. 2020
    A Study on Efficiency in Continual Learning Inspired by Human LearningPhilip Ball, Yingzhen Li, Angus Lamb, Cheng ZhangarXiv
    PDF ↗
  13. 2020
    Continual Unsupervised Domain Adaptation for Semantic SegmentationJoonhyuk Kim, Sahng-Min Yoo, Gyeong-Moon Park, Jong-Hwan KimarXiv
    PDF ↗
  14. 2020
    Continual Learning for Neural Semantic ParsingVladislav Lialin, Rahul Goel, Andrey Simanovsky … Rushin ShaharXiv · University of Massachusetts Lowell · Google (United States)
    PDF ↗
  15. 2020PDF ↗
  16. 2020
    The Effectiveness of Memory Replay in Large Scale Continual LearningYogesh Balaji, Mehrdad Farajtabar, Dong Yin … Ang LiarXiv
    PDF ↗
  17. 2020
    Meta-Aggregating Networks for Class-Incremental LearningYaoyao Liu, B. Schiele, Qianru SunarXiv
  18. 2020
    Neurocoder: Learning General-Purpose Computation Using Stored Neural ProgramsHung Lê, Svetha VenkatesharXiv · Deakin University
    PDF ↗
  19. 2020
    Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the JobBing Liu, Sahisnu MazumderarXiv · University of Illinois Chicago
    PDF ↗
  20. 2020
    Few-Shot Unsupervised Continual Learning through Meta-ExamplesAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniarXiv · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  21. 2020
    Measuring Information Transfer in Neural NetworksXiao Zhang, Xingjian Li, Dejing Dou, Ji WuarXiv · Tsinghua University · Baidu (China)
    PDF ↗
  22. 2020
    Meta-Learning with Sparse Experience Replay for Lifelong Language LearningNithin Holla, Pushkar Mishra, Helen Yannakoudakis, Ekaterina ShutovaarXiv · Meta (Israel) · King's College London · +1
    PDF ↗
  23. 2020
    Routing Networks with Co-training for Continual LearningMark Collier, Efi Kokiopoulou, Andréa Gesmundo, Jesse BerentarXiv · Google (United States)
    PDF ↗
  24. 2020
    Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language ModellingTsendsuren MunkhdalaiarXiv · Microsoft Research (United Kingdom)
    PDF ↗
  25. 2020
    Compression-aware Continual Learning using Singular Value DecompositionVarigonda Pavan Teja, Priyadarshini PandaarXiv · Yale University
    PDF ↗
  26. 2020
    Lifelong Object DetectionZhou Wang, Shiyu Chang, Norma Sosa … David CoxarXiv
    PDF ↗
  27. 2020PDF ↗
  28. 2020
    Meta Continual Learning via Dynamic ProgrammingKrishnan, R., Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  29. 2020
    Lifelong NavigationBo Liu, Xuesu Xiao, Peter StonearXiv · The University of Texas at Austin
    PDF ↗
  30. 2020PDF ↗
  31. 2020
    Multilayer Neuromodulated Architectures for Memory-Constrained Online Continual LearningSandeep Madireddy, Ángel Yanguas-Gil, Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  32. 2020
    Lifelong Learning using Eigentasks: Task Separation, Skill Acquisition, and Selective TransferAswin Raghavan, Jesse Hostetler, Indranil Sur … Ajay DivakaranarXiv · SRI International
    PDF ↗
  33. 2020
    Disentanglement of Color and Shape Representations for Continual LearningDavid Berga, Marc Masana, Joost van de WeijerarXiv
    PDF ↗
  34. 2020
    Batch-level Experience Replay with Review for Continual LearningZheda Mai, Hyunwoo Kim, Jihwan Jeong, Scott SannerarXiv · University of Toronto
    PDF ↗
  35. 2020
    Wandering within a World: Online Contextualized Few-Shot LearningMengye Ren, Michael L. Iuzzolino, Michael C. Mozer, Richard S. ZemelarXiv · University of Toronto · University of Colorado Boulder · +1
    PDF ↗
  36. 2020PDF ↗
  37. 2020
    Towards a practical measure of interference for reinforcement learningVincent Liu, Adam White, Hengshuai Yao, Martha WhitearXiv
    PDF ↗
  38. 2020PDF ↗
  39. 2020
    Pseudo-Rehearsal for Continual Learning with Normalizing FlowsJary Pomponi, Simone Scardapane, Aurelio UnciniarXiv · Sapienza University of Rome
    PDF ↗
  40. 2020
    On Class Orderings for Incremental LearningMarc Masana, Bartłomiej Twardowski, Joost van de WeijerarXiv
    PDF ↗
  41. 2020
    Eliminating Catastrophic Interference with Biased CompetitionAmelia Elizabeth Pollard, Jonathan ShapiroarXiv
    PDF ↗
  42. 2020PDF ↗
  43. 2020
    Few-Shot Class-Incremental Learning via Feature Space CompositionHanbin Zhao, Yongjian Fu, Xue-Wei Li … Xi LiarXiv
  44. 2020
    Gradient Based Memory Editing for Task-Free Continual LearningXisen Jin, Arka Sadhu, Junyi Du, Xiang RenarXiv
  45. 2020
    Storing Encoded Episodes as Concepts for Continual LearningAli Ayub, Alan R. WagnerarXiv · Pennsylvania State University
    PDF ↗
  46. 2020
    Bookworm continual learning: beyond zero-shot learning and continual learningKai Wang, Luis Herranz, Anjan Dutta, Joost van de WeijerarXiv · Universitat Autònoma de Barcelona
    PDF ↗
  47. 2020PDF ↗
  48. 2020
    Continual Learning in Recurrent Neural Networks with HypernetworksBenjamin Ehret, Christian Henning, Maria R. Cervera … Benjamin F. GrewearXiv · ETH Zurich
    PDF ↗
  49. 2020
    Automatic Recall Machines: Internal Replay, Continual Learning and the BrainXu Ji, João F. Henriques, Tinne Tuytelaars, Andrea VedaldiarXiv
    PDF ↗
  50. 2020PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.