Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

1,587 papers of 4,574 · showing 1451–1500Sort Recent · Most cited
  1. 2020PDF ↗
  2. 2020
    Bayesian Nonparametric Weight Factorization for Continual LearningNikhil Mehta, Kevin J Liang, Vinay Kumar Verma, Lawrence CarinarXiv
    PDF ↗
  3. 2020
    Continual Reinforcement Learning with Multi-Timescale ReplayChristos Kaplanis, Claudia Clopath, Murray ShanahanarXiv · Imperial College London
    PDF ↗
  4. 2020
    Defining Benchmarks for Continual Few-Shot LearningAntreas Antoniou, Massimiliano Patacchiola, Mateusz Ochal, Amos StorkeyarXiv · University of Edinburgh
    PDF ↗
  5. 2020
    CALM: Continuous Adaptive Learning for Language ModelingKristjan Arumae, Parminder BhatiaarXiv · Amazon (Germany)
    PDF ↗
  6. 2020
    Class-Agnostic Continual Learning of Alternating Languages and DomainsGermán Kruszewski, Ionut Sorodoc, Tomáš MikolovarXiv · Naver (South Korea) · Universitat Pompeu Fabra
    PDF ↗
  7. 2020
    Improved Pretraining for Domain-specific Contextual Embedding ModelsSubendhu Rongali, Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong YuarXiv · University of Massachusetts Amherst
    PDF ↗
  8. 2020
    Towards Lifelong Self-Supervision For Unpaired Image-to-Image TranslationVictor Schmidt, Makesh Narsimhan Sreedhar, Mostafa ElAraby, Irina RisharXiv
    PDF ↗
  9. 2020
    Continual Graph LearningFan Zhou, Chengtai CaoarXiv
    PDF ↗
  10. 2020
    Lifelong Learning with Searchable Extension UnitsWenjin Wang, Yunqing Hu, Yin Zhang⋆arXiv · Zhejiang University
    PDF ↗
  11. 2020
    Evaluating Logical Generalization in Graph Neural NetworksKoustuv Sinha, Shagun Sodhani, Joëlle Pineau, William L. HamiltonarXiv · McGill University
    PDF ↗
  12. 2020
    On Catastrophic Interference in Atari 2600 GamesWilliam Fedus, Dibya Ghosh, John D. Martin … Hugo LarochellearXiv
    PDF ↗
  13. 2020PDF ↗
  14. 2020
    Continual Universal Object DetectionXialei Liu, Hao Yang, Avinash Ravichandran … Stefano SoattoarXiv · Universitat Autònoma de Barcelona · Amazon (Germany)
    PDF ↗
  15. 2020
    A Novel Incremental Cross-Modal Hashing ApproachDevraj Mandal, Soma BiswasarXiv · Indian Institute of Science Bangalore
    PDF ↗
  16. 2020
    Ternary Feature Masks: continual learning without any forgettingMarc Masana, T. Tuytelaars, Joost van de WeijerarXiv
    PDF ↗
  17. 2020
    Dissecting Catastrophic Forgetting in Continual Learning by Deep VisualizationGiang Nguyen, Chen Shuan, Thao Do … Daeyoung KimarXiv
    PDF ↗
  18. 2019
    Side-Tuning: Network Adaptation via Additive Side NetworksJeffrey O. Zhang, Alexander F. Sax, Amir Zamir … Jitendra MalikarXiv
    PDF ↗
  19. 2019PDF ↗
  20. 2019PDF ↗
  21. 2019
    Learning Sparse Representations Incrementally in Deep Reinforcement LearningJ. Fernando Hernandez-Garcia, Richard S. SuttonarXiv · University of Alberta
    PDF ↗
  22. 2019
    Bayesian Structure Adaptation for Continual LearningAbhishek Kumar, Sunabha Chatterjee, Piyush RaiarXiv · Indian Institute of Technology Kanpur
    PDF ↗
  23. 2019
    Regularization Shortcomings for Continual LearningTimothée Lesort, Andrei Stoian, Filliat, DavidarXiv · École d'Ingénieurs en Chimie et Sciences du Numérique · Thales (Portugal)
    PDF ↗
  24. 2019
    GRIm-RePR: Prioritising Generating Important Features for Pseudo-RehearsalC. Atkinson, Brendan McCane, Lech Szymanski, Anthony RobinsarXiv
    PDF ↗
  25. 2019
    A Unified Framework for Lifelong Learning in Deep Neural NetworksCharles X. Ling, Tanner BohnarXiv · Western University
    PDF ↗
  26. 2019
    Online Learned Continual Compression with Stacked Quantization ModuleLucas Caccia, Eugene Belilovsky, M. Caccia, Joëlle PineauarXiv · McGill University · Meta (Israel)
    PDF ↗
  27. 2019PDF ↗
  28. 2019
    Continual Multi-task Gaussian ProcessesPablo Moreno-Muñoz, Antonio Artés-Rodrı́guez, Mauricio A. ÁlvarezarXiv · Universidad Carlos III de Madrid · University of Sheffield
    PDF ↗
  29. 2019PDF ↗
  30. 2019
    Overcoming Forgetting in Federated Learning on Non-IID DataNeta Shoham, Tomer Avidor, Aviv Keren … Itai ZeitakarXiv
    PDF ↗
  31. 2019
    Learning to Remember from a Multi-Task TeacherYuwen Xiong, Mengye Ren, Raquel UrtasunarXiv
    PDF ↗
  32. 2019PDF ↗
  33. 2019
    Is Fast Adaptation All You Need?Khurram Javed, Hengshuai Yao, Martha WhitearXiv · University of Alberta · Huawei Technologies (China)
    PDF ↗
  34. 2019PDF ↗
  35. 2019
    Learning with Long-term Remembering: Following the Lead of Mixed Stochastic GradientYunhui Guo, Mingrui Liu, Tianbao Yang, Tajana RosingarXiv · University of California San Diego · University of Iowa
    PDF ↗
  36. 2019
    ContCap: A scalable framework for continual image captioningGiang Nguyen, Tae Joon Jun, Trung Tran … Daeyoung KimarXiv
    PDF ↗
  37. 2019
    Neural Architecture Search for Class-incremental LearningShenyang Huang, Vincent François-Lavet, Guillaume RabusseauarXiv
    PDF ↗
  38. 2019PDF ↗
  39. 2019
    Learning sparse representations in reinforcement learningJacob Rafati, David C. NoellearXiv · University of California, Merced
    PDF ↗
  40. 2019
    Learning Continually from Low-shot Data StreamCanyu Le, Xihan Wei, Biao Wang … Chen, ZhongguiarXiv
    PDF ↗
  41. 2019
    Online Continual Learning with Maximally Interfered RetrievalRahaf Aljundi, Lucas Caccia, Eugene Belilovsky … Tinne TuytelaarsarXiv · McGill University · Université de Montréal · +1
    PDF ↗
  42. 2019
    Toward Understanding Catastrophic Forgetting in Continual LearningCuong V. Nguyen, Alessandro Achille, Michael Lam … Stefano SoattoarXiv
    PDF ↗
  43. 2019PDF ↗
  44. 2019
    Biologically inspired sleep algorithm for artificial neural networksGiri P. Krishnan, Timothy Tadros, Ramyaa Ramyaa, Maxim BazhenovarXiv
    PDF ↗
  45. 2019PDF ↗
  46. 2019
    Rethinking Continual Learning for Autonomous Agents and RobotsGerman I. Parisi, Christopher KananarXiv · Universität Hamburg · Rochester Institute of Technology
    PDF ↗
  47. 2019
    Beneficial perturbation network for continual learningShixian Wen, Laurent IttiarXiv · University of Southern California · California Southern University
    PDF ↗
  48. 2019
    Continual Reinforcement Learning with Diversity Exploration and Adversarial Self-CorrectionFengda Zhu, Xiaojun Chang, Runhao Zeng, Mingkui TanarXiv · South China University of Technology
    PDF ↗
  49. 2019PDF ↗
  50. 2019
    Conditional Computation for Continual LearningMin Lin, Jie Fu, Yoshua BengioarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.