Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

60 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2020
    Learning Invariant Representation for Continual LearningGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiyarXiv · Eindhoven University of Technology · University of Twente
    PDF ↗
  2. 2020
    Selective Forgetting of Deep Networks at a Finer Level than SamplesTomohiro Hayase, Suguru Yasutomi, Takashi KatoharXiv
    PDF ↗
  3. 2020
    Consequences of Slow Neural Dynamics for Incremental LearningShima Rahimi Moghaddam, Fanjun Bu, Christopher J. HoneyarXiv
    PDF ↗
  4. 2020
    Association: Remind Your GAN not to ForgetYi Gu, Jie Li, Yuting Gao … Zhang, ZiruiarXiv
    PDF ↗
  5. 2020
    Consolidation via Policy Information Regularization in Deep RL for Multi-Agent GamesTyler Malloy, Tim Klinger, Miao Liu … Chris R. SimsarXiv
    PDF ↗
  6. 2020PDF ↗
  7. 2020
    Continual Learning with Deep Artificial NeuronsBlake Camp, Jaya Krishna Mandivarapu, Rolando EstradaarXiv · Georgia State University
    PDF ↗
  8. 2020
    Meta-Learning for Natural Language Understanding under Continual Learning FrameworkJiacheng Wang, Yong Fan, Duo Jiang, Shiqing LiarXiv · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +1
    PDF ↗
  9. 2020
    A Study on Efficiency in Continual Learning Inspired by Human LearningPhilip Ball, Yingzhen Li, Angus Lamb, Cheng ZhangarXiv
    PDF ↗
  10. 2020
    Continual Unsupervised Domain Adaptation for Semantic SegmentationJoonhyuk Kim, Sahng-Min Yoo, Gyeong-Moon Park, Jong-Hwan KimarXiv
    PDF ↗
  11. 2020
    Continual Learning for Neural Semantic ParsingVladislav Lialin, Rahul Goel, Andrey Simanovsky … Rushin ShaharXiv · University of Massachusetts Lowell · Google (United States)
    PDF ↗
  12. 2020
    The Effectiveness of Memory Replay in Large Scale Continual LearningYogesh Balaji, Mehrdad Farajtabar, Dong Yin … Ang LiarXiv
    PDF ↗
  13. 2020
    Neurocoder: Learning General-Purpose Computation Using Stored Neural ProgramsHung Lê, Svetha VenkatesharXiv · Deakin University
    PDF ↗
  14. 2020
    Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the JobBing Liu, Sahisnu MazumderarXiv · University of Illinois Chicago
    PDF ↗
  15. 2020
    Few-Shot Unsupervised Continual Learning through Meta-ExamplesAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniarXiv · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  16. 2020
    Measuring Information Transfer in Neural NetworksXiao Zhang, Xingjian Li, Dejing Dou, Ji WuarXiv · Tsinghua University · Baidu (China)
    PDF ↗
  17. 2020
    Meta-Learning with Sparse Experience Replay for Lifelong Language LearningNithin Holla, Pushkar Mishra, Helen Yannakoudakis, Ekaterina ShutovaarXiv · Meta (Israel) · King's College London · +1
    PDF ↗
  18. 2020
    Routing Networks with Co-training for Continual LearningMark Collier, Efi Kokiopoulou, Andréa Gesmundo, Jesse BerentarXiv · Google (United States)
    PDF ↗
  19. 2020
    Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language ModellingTsendsuren MunkhdalaiarXiv · Microsoft Research (United Kingdom)
    PDF ↗
  20. 2020
    Compression-aware Continual Learning using Singular Value DecompositionVarigonda Pavan Teja, Priyadarshini PandaarXiv · Yale University
    PDF ↗
  21. 2020
    Lifelong Object DetectionZhou Wang, Shiyu Chang, Norma Sosa … David CoxarXiv
    PDF ↗
  22. 2020
    Lifelong NavigationBo Liu, Xuesu Xiao, Peter StonearXiv · The University of Texas at Austin
    PDF ↗
  23. 2020PDF ↗
  24. 2020
    Multilayer Neuromodulated Architectures for Memory-Constrained Online Continual LearningSandeep Madireddy, Ángel Yanguas-Gil, Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  25. 2020
    Lifelong Learning using Eigentasks: Task Separation, Skill Acquisition, and Selective TransferAswin Raghavan, Jesse Hostetler, Indranil Sur … Ajay DivakaranarXiv · SRI International
    PDF ↗
  26. 2020
    Disentanglement of Color and Shape Representations for Continual LearningDavid Berga, Marc Masana, Joost van de WeijerarXiv
    PDF ↗
  27. 2020
    Batch-level Experience Replay with Review for Continual LearningZheda Mai, Hyunwoo Kim, Jihwan Jeong, Scott SannerarXiv · University of Toronto
    PDF ↗
  28. 2020
    Towards a practical measure of interference for reinforcement learningVincent Liu, Adam White, Hengshuai Yao, Martha WhitearXiv
    PDF ↗
  29. 2020
    On Class Orderings for Incremental LearningMarc Masana, Bartłomiej Twardowski, Joost van de WeijerarXiv
    PDF ↗
  30. 2020
    Eliminating Catastrophic Interference with Biased CompetitionAmelia Elizabeth Pollard, Jonathan ShapiroarXiv
    PDF ↗
  31. 2020
    Storing Encoded Episodes as Concepts for Continual LearningAli Ayub, Alan R. WagnerarXiv · Pennsylvania State University
    PDF ↗
  32. 2020
    Bookworm continual learning: beyond zero-shot learning and continual learningKai Wang, Luis Herranz, Anjan Dutta, Joost van de WeijerarXiv · Universitat Autònoma de Barcelona
    PDF ↗
  33. 2020PDF ↗
  34. 2020
    Continual Learning in Recurrent Neural Networks with HypernetworksBenjamin Ehret, Christian Henning, Maria R. Cervera … Benjamin F. GrewearXiv · ETH Zurich
    PDF ↗
  35. 2020
    Automatic Recall Machines: Internal Replay, Continual Learning and the BrainXu Ji, João F. Henriques, Tinne Tuytelaars, Andrea VedaldiarXiv
    PDF ↗
  36. 2020
    Generalisation Guarantees for Continual Learning with Orthogonal Gradient DescentMehdi Bennani, Thang Doan, Masashi SugiyamaarXiv · École Nationale Supérieure des Mines de Paris · McGill University · +1
    PDF ↗
  37. 2020
    SOLA: Continual Learning with Second-Order Loss ApproximationDong Yin, Mehrdad Farajtabar, Ang Li … A. MottarXiv
    PDF ↗
  38. 2020PDF ↗
  39. 2020
    Learning Causal Models OnlineKhurram Javed, Martha White, Yoshua BengioarXiv
    PDF ↗
  40. 2020
    BI-MAML: Balanced Incremental Approach for Meta LearningYang Zheng, Jinlin Xiang, Kun Su, Eli ShlizermanarXiv
    PDF ↗
  41. 2020
    Collaborative and continual learning for classification tasks in a society of devicesFernando E. Casado, Dylan Lema, Roberto Iglesias … Senén BarroarXiv
    PDF ↗
  42. 2020
    Move-to-Data: A new Continual Learning approach with Deep CNNs, Application for image-class recognitionMiltiadis Poursanidis, Jenny Benois‐Pineau, Akka Zemmari … Aymar de RugyarXiv · Laboratoire Bordelais de Recherche en Informatique · Institut de Neurosciences Cognitives et Intégratives d’Aquitaine
    PDF ↗
  43. 2020
    Understanding Regularisation Methods for Continual LearningFrederik BenzingarXiv · École Polytechnique Fédérale de Lausanne
    PDF ↗
  44. 2020
    Progressive growing of self-organized hierarchical representations for explorationMayalen Etcheverry, Pierre‐Yves Oudeyer, Chris ReinkearXiv
    PDF ↗
  45. 2020
    Visually Grounded Continual Learning of Compositional SemanticsXisen Jin, Junyi Du, Arka Sadhu … Xiang RenarXiv · University of Southern California · California Southern University
    PDF ↗
  46. 2020
    Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual LearningZihan Liu, Genta Indra Winata, Andrea Madotto, Pascale FungarXiv · Hong Kong University of Science and Technology
    PDF ↗
  47. 2020
    Neural Network Retraining for Model ServingDiego Klabjan, Xiaofeng ZhuarXiv
    PDF ↗
  48. 2020PDF ↗
  49. 2020
    Bayesian Nonparametric Weight Factorization for Continual LearningNikhil Mehta, Kevin J Liang, Vinay Kumar Verma, Lawrence CarinarXiv
    PDF ↗
  50. 2020
    Continual Reinforcement Learning with Multi-Timescale ReplayChristos Kaplanis, Claudia Clopath, Murray ShanahanarXiv · Imperial College London
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.