Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

311 papers of 8,653 · showing 201–250Sort Recent · Most cited
  1. 2022
    SparCL: Sparse Continual Learning on the EdgeZifeng Wang, Zheng Zhan, Yifan Gong … Jennifer DyNeurIPS
    PDF ↗
  2. 2022PDF ↗
  3. 2022
    Repairing Neural Networks by Leaving the Right Past BehindRyutaro Tanno, Melanie F. Pradier, Aditya Nori, Yingzhen LiNeurIPS
    PDF ↗
  4. 2022
    Lifelong Inverse Reinforcement LearningJorge A. Mendez, Shashank Shivkumar, Eric EatonNeurIPS · University of Pennsylvania · Philadelphia University
    PDF ↗
  5. 2022
    CLiMB: A Continual Learning Benchmark for Vision-and-Language TasksTejas Srinivasan, Ting-Yun Chang, Leticia Leonor Pinto Alva … Jesse ThomasonNeurIPS
    PDF ↗
  6. 2022PDF ↗
  7. 2022
    ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy ProtectionHuiping Zhuang, Zhenyu Weng, Wei, Hongxin … Zhiping LinNeurIPS
    PDF ↗
  8. 2022PDF ↗
  9. 2022
    The CLEAR Benchmark: Continual LEArning on Real-World ImageryZhiqiu Lin, Jia Shi, Deepak Pathak, Deva RamananNeurIPS
    PDF ↗
  10. 2022
    Preservation of the Global Knowledge by Not-True Distillation in Federated LearningGihun Lee, Minchan Jeong, Yongjin Shin … Se-Young YunNeurIPS
    PDF ↗
  11. 2022
    CGLB: Benchmark Tasks for Continual Graph LearningXikun Zhang, Dongjin Song, Dacheng TaoNeurIPS
  12. 2022
    Memory Efficient Continual Learning with TransformersBeyza Ermis, Giovanni Zappella, Martin Wistuba … Cédric ArchambeauNeurIPS
    PDF ↗
  13. 2022
    Repeated Augmented Rehearsal: A Simple but Strong Baseline for Online Continual LearningYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
    PDF ↗
  14. 2022
    Retrospective Adversarial Replay for Continual LearningLilly Kumari, Shengjie Wang, Tianyi Zhou, Jeff BilmesNeurIPS
  15. 2022
  16. 2019
    Lifelong Neural Predictive Coding: Learning Cumulatively Online without ForgettingAlex Ororbia, Ankur Mali, C Lee Giles, Daniel KiferNeurIPS
    PDF ↗
  17. 2022
    Continual Learning In Environments With Polynomial Mixing TimesMatthew Riemer, Sharath Chandra Raparthy, Ignacio Cases … Irina RishNeurIPS
    PDF ↗
  18. 2022
    Continual Learning with Evolving Class OntologiesZhiqiu Lin, Deepak Pathak, Yu-Xiong Wang … Shu KongNeurIPS
    PDF ↗
  19. 2022
  20. 2022
    A simple but strong baseline for online continual learning: Repeated Augmented RehearsalYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
  21. 2021
    How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?Dong, Xinhsuai, Tuan, Luu Anh, Min Lin … Hanwang ZhangNeurIPS
    PDF ↗
  22. 2020PDF ↗
  23. 2021PDF ↗
  24. 2021
    Continual Learning via Local Module CompositionOleksiy Ostapenko, Pau Rodríguez, M. Caccia, Laurent CharlinNeurIPS · Taras Shevchenko National University of Kyiv · University of Insubria · +1
    PDF ↗
  25. 2021
    Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat MinimaGuangyuan Shi, Jiaxin Chen, Wenlong Zhang … Xiao-Ming WuNeurIPS · Hong Kong Polytechnic University
    PDF ↗
  26. 2021
    Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object DetectionNa Dong, Yongqiang Zhang, Mingli Ding, Gim Hee LeeNeurIPS · Harbin Institute of Technology · National University of Singapore
    PDF ↗
  27. 2021
    Learning where to learn: Gradient sparsity in meta and continual learningJohannes von Oswald, Dominic Zhao, Seijin Kobayashi … João SacramentoNeurIPS
    PDF ↗
  28. 2021
    AFEC: Active Forgetting of Negative Transfer in Continual LearningLiyuan Wang, Ming‐Tian Zhang, Zhongfan Jia … Yi ZhongNeurIPS · Tsinghua University · University College London
    PDF ↗
  29. 2021
    Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual LearningDanruo Deng, Guangyong Chen, Jianye Hao … Pheng‐Ann HengNeurIPS · Chinese University of Hong Kong · Shenzhen Institutes of Advanced Technology · +1
    PDF ↗
  30. 2021
    Powerpropagation: A sparsity inducing weight reparameterisationJonathan Schwarz, Siddhant M. Jayakumar, Razvan Pascanu … Yee Whye TehNeurIPS · Google (United States)
    PDF ↗
  31. 2021
    Formalizing the Generalization-Forgetting Trade-off in Continual LearningKrishnan Raghavan, Prasanna BalaprakashNeurIPS · Argonne National Laboratory
    PDF ↗
  32. 2021
    SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental LearningSungmin Cha, Beomyoung Kim, Youngjoon Yoo, Taesup MoonNeurIPS · Sungkyunkwan University · Naver (South Korea) · +1
    PDF ↗
  33. 2021
    Natural continual learning: success is a journey, not (just) a destinationTa-Chu Kao, Kristopher T. Jensen, Gido M. van de Ven … Guillaume HennequinNeurIPS
    PDF ↗
  34. 2021
    Optimizing Reusable Knowledge for Continual Learning via MetalearningJulio Hurtado, Alain Raymond-Sáez, Álvaro SotoNeurIPS · Pontificia Universidad Católica de Chile
    PDF ↗
  35. 2021
    A Procedural World Generation Framework for Systematic Evaluation of Continual LearningTimm Hess, Martin Mundt, Iuliia Pliushch, Visvanathan RameshNeurIPS · Goethe University Frankfurt
    PDF ↗
  36. 2021
    Continual World: A Robotic Benchmark For Continual Reinforcement LearningMaciej Wołczyk, Michał Zając, Razvan Pascanu … Piotr MiłośNeurIPS · Jagiellonian University · Google (United States)
    PDF ↗
  37. 2021
    CAM-GAN: Continual Adaptation Modules for Generative Adversarial NetworksSakshi Varshney, Vinay Kumar Verma, P K Srijith … Piyush RaiNeurIPS
    PDF ↗
  38. 2020
    Firefly Neural Architecture Descent: a General Approach for Growing Neural NetworksLemeng Wu, Bo Liu, Peter Stone, Qiang LiuNeurIPS · The University of Texas at Austin
    PDF ↗
  39. 2021
    Posterior Meta-Replay for Continual LearningChristian Henning, Maria R. Cervera, Francesco D'Angelo … João SacramentoNeurIPS
    PDF ↗
  40. 2021
    Class-Incremental Learning via Dual AugmentationFei Zhu, Zhen Cheng, Xu-Yao Zhang, Cheng-Lin LiuNeurIPS
  41. 2021
  42. 2021
    BNS: Building Network Structures Dynamically for Continual LearningQi Qin, Han Peng, Wen-Rui Hu … Bing LiuNeurIPS
  43. 2021
  44. 2021
    Generative vs. Discriminative: Rethinking The Meta-Continual LearningMohammadamin Banayeeanzade, Rasoul Mirzaiezadeh, Hosein Hasani, Mahdieh SoleymaniNeurIPS
  45. 2021
    Continual Auxiliary Task LearningAuthors pendingNeurIPS
  46. 2021
  47. 2020
    A Combinatorial Perspective on Transfer LearningJianan Wang, Eren Sezener, David Budden … Joel VenessNeurIPS · Google (United States)
    PDF ↗
  48. 2020
    Continual Learning in Low-rank Orthogonal SubspacesArslan Chaudhry, Naeemullah Khan, Puneet K. Dokania, Philip H. S. TorrNeurIPS · University of Oxford
    PDF ↗
  49. 2020
    Meta-Consolidation for Continual LearningK J Joseph, Vineeth N BalasubramanianNeurIPS · Indian Institute of Technology Hyderabad
    PDF ↗
  50. 2020
    La-MAML: Look-ahead Meta Learning for Continual LearningGunshi Gupta, Karmesh Yadav, Liam PaullNeurIPS · Carnegie Mellon University · Université de Montréal
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.