Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

108 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2020
    Learning Invariant Representation for Continual LearningGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiyarXiv · Eindhoven University of Technology · University of Twente
    PDF ↗
  2. 2020PDF ↗
  3. 2020
    Selective Forgetting of Deep Networks at a Finer Level than SamplesTomohiro Hayase, Suguru Yasutomi, Takashi KatoharXiv
    PDF ↗
  4. 2020
    R-Hero: A Software Repair Bot based on Continual LearningB. Baudry, Zimin Chen, K. Etemadi … Zhongxing YuarXiv
  5. 2020
    Sparsifying networks by traversing GeodesicsGuruprasad Raghavan, Matt ThomsonarXiv · California Institute of Technology
    PDF ↗
  6. 2020
    Consequences of Slow Neural Dynamics for Incremental LearningShima Rahimi Moghaddam, Fanjun Bu, Christopher J. HoneyarXiv
    PDF ↗
  7. 2020
    Association: Remind Your GAN not to ForgetYi Gu, Jie Li, Yuting Gao … Zhang, ZiruiarXiv
    PDF ↗
  8. 2020
    Continual learning with direction-constrained optimizationYunfei Teng, A. Choromańska, Murray CampbellarXiv
  9. 2020
    Lethean Attack: An Online Data Poisoning TechniqueEyal PerryarXiv · Massachusetts Institute of Technology
    PDF ↗
  10. 2020
    Consolidation via Policy Information Regularization in Deep RL for Multi-Agent GamesTyler Malloy, Tim Klinger, Miao Liu … Chris R. SimsarXiv
    PDF ↗
  11. 2020
    Generalized Continual Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramarXiv · Indian Institute of Science Bangalore · Indian Institute of Technology Madras
    PDF ↗
  12. 2020PDF ↗
  13. 2020
    Continual Learning with Deep Artificial NeuronsBlake Camp, Jaya Krishna Mandivarapu, Rolando EstradaarXiv · Georgia State University
    PDF ↗
  14. 2020
    Learning Translation Invariance in CNNsValerio Biscione, Jeffrey S. BowersarXiv · University of Bristol
    PDF ↗
  15. 2020
    Meta-Learning for Natural Language Understanding under Continual Learning FrameworkJiacheng Wang, Yong Fan, Duo Jiang, Shiqing LiarXiv · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +1
    PDF ↗
  16. 2020
    A Study on Efficiency in Continual Learning Inspired by Human LearningPhilip Ball, Yingzhen Li, Angus Lamb, Cheng ZhangarXiv
    PDF ↗
  17. 2020
    Continual Unsupervised Domain Adaptation for Semantic SegmentationJoonhyuk Kim, Sahng-Min Yoo, Gyeong-Moon Park, Jong-Hwan KimarXiv
    PDF ↗
  18. 2020
    Continual Learning for Neural Semantic ParsingVladislav Lialin, Rahul Goel, Andrey Simanovsky … Rushin ShaharXiv · University of Massachusetts Lowell · Google (United States)
    PDF ↗
  19. 2020PDF ↗
  20. 2020
    The Effectiveness of Memory Replay in Large Scale Continual LearningYogesh Balaji, Mehrdad Farajtabar, Dong Yin … Ang LiarXiv
    PDF ↗
  21. 2020PDF ↗
  22. 2020
    Meta-Aggregating Networks for Class-Incremental LearningYaoyao Liu, B. Schiele, Qianru SunarXiv
  23. 2020
    Neurocoder: Learning General-Purpose Computation Using Stored Neural ProgramsHung Lê, Svetha VenkatesharXiv · Deakin University
    PDF ↗
  24. 2020
    Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the JobBing Liu, Sahisnu MazumderarXiv · University of Illinois Chicago
    PDF ↗
  25. 2020
    Few-Shot Unsupervised Continual Learning through Meta-ExamplesAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniarXiv · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  26. 2020
    Measuring Information Transfer in Neural NetworksXiao Zhang, Xingjian Li, Dejing Dou, Ji WuarXiv · Tsinghua University · Baidu (China)
    PDF ↗
  27. 2020
    Meta-Learning with Sparse Experience Replay for Lifelong Language LearningNithin Holla, Pushkar Mishra, Helen Yannakoudakis, Ekaterina ShutovaarXiv · Meta (Israel) · King's College London · +1
    PDF ↗
  28. 2020
    Assessing Game Balance with AlphaZero: Exploring Alternative Rule Sets in ChessNenad Tomašev, Ulrich Paquet, Demis Hassabis, Vladimir KramnikarXiv
    PDF ↗
  29. 2020
    Routing Networks with Co-training for Continual LearningMark Collier, Efi Kokiopoulou, Andréa Gesmundo, Jesse BerentarXiv · Google (United States)
    PDF ↗
  30. 2020
    Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language ModellingTsendsuren MunkhdalaiarXiv · Microsoft Research (United Kingdom)
    PDF ↗
  31. 2020
    Compression-aware Continual Learning using Singular Value DecompositionVarigonda Pavan Teja, Priyadarshini PandaarXiv · Yale University
    PDF ↗
  32. 2020
    Lifelong Object DetectionZhou Wang, Shiyu Chang, Norma Sosa … David CoxarXiv
    PDF ↗
  33. 2020
    Problems in AI research and how the SP System may help to solve themJ. Gerard WolffarXiv · University of Freiburg
    PDF ↗
  34. 2020PDF ↗
  35. 2020
    Analysis of Social Robotic Navigation approaches: CNN Encoder and Incremental Learning as an alternative to Deep Reinforcement LearningJanderson Ferreira, Júnior, Agostinho A. F., Letícia Castro … Bruno FernandesarXiv · Universidade de Pernambuco · Italian Institute of Technology
    PDF ↗
  36. 2020
    Meta Continual Learning via Dynamic ProgrammingKrishnan, R., Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  37. 2020PDF ↗
  38. 2020
    Lifelong NavigationBo Liu, Xuesu Xiao, Peter StonearXiv · The University of Texas at Austin
    PDF ↗
  39. 2020PDF ↗
  40. 2020
    Multilayer Neuromodulated Architectures for Memory-Constrained Online Continual LearningSandeep Madireddy, Ángel Yanguas-Gil, Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  41. 2020
    Lifelong Learning using Eigentasks: Task Separation, Skill Acquisition, and Selective TransferAswin Raghavan, Jesse Hostetler, Indranil Sur … Ajay DivakaranarXiv · SRI International
    PDF ↗
  42. 2020
    Disentanglement of Color and Shape Representations for Continual LearningDavid Berga, Marc Masana, Joost van de WeijerarXiv
    PDF ↗
  43. 2020
    Batch-level Experience Replay with Review for Continual LearningZheda Mai, Hyunwoo Kim, Jihwan Jeong, Scott SannerarXiv · University of Toronto
    PDF ↗
  44. 2020
    Pre-trained Word Embeddings for Goal-conditional Transfer Learning in Reinforcement LearningMatthias Hutsebaut-Buysse, Kevin Mets, Steven LatréarXiv · University of Antwerp
    PDF ↗
  45. 2020
    Wandering within a World: Online Contextualized Few-Shot LearningMengye Ren, Michael L. Iuzzolino, Michael C. Mozer, Richard S. ZemelarXiv · University of Toronto · University of Colorado Boulder · +1
    PDF ↗
  46. 2020
    Towards a practical measure of interference for reinforcement learningVincent Liu, Adam White, Hengshuai Yao, Martha WhitearXiv
    PDF ↗
  47. 2020
    Pseudo-Rehearsal for Continual Learning with Normalizing FlowsJary Pomponi, Simone Scardapane, Aurelio UnciniarXiv · Sapienza University of Rome
    PDF ↗
  48. 2020
    On Class Orderings for Incremental LearningMarc Masana, Bartłomiej Twardowski, Joost van de WeijerarXiv
    PDF ↗
  49. 2020
    Eliminating Catastrophic Interference with Biased CompetitionAmelia Elizabeth Pollard, Jonathan ShapiroarXiv
    PDF ↗
  50. 2020PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.