Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

28 papers of 8,653Sort Recent · Most cited
  1. 2021
    Preservation of the Global Knowledge by Not-True Distillation in Federated LearningGihun Lee, Minchan Jeong, Yongjin Shin … Se-Young YunNeurIPS
    PDF ↗
  2. 2021
    Continual Learning In Environments With Polynomial Mixing TimesMatthew Riemer, Sharath Chandra Raparthy, Ignacio Cases … Irina RishNeurIPS
    PDF ↗
  3. 2021
    How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?Dong, Xinhsuai, Tuan, Luu Anh, Min Lin … Hanwang ZhangNeurIPS
    PDF ↗
  4. 2021PDF ↗
  5. 2021PDF ↗
  6. 2021
    Continual Learning via Local Module CompositionOleksiy Ostapenko, Pau Rodríguez, M. Caccia, Laurent CharlinNeurIPS · Taras Shevchenko National University of Kyiv · University of Insubria · +1
    PDF ↗
  7. 2021
    Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat MinimaGuangyuan Shi, Jiaxin Chen, Wenlong Zhang … Xiao-Ming WuNeurIPS · Hong Kong Polytechnic University
    PDF ↗
  8. 2021
    Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object DetectionNa Dong, Yongqiang Zhang, Mingli Ding, Gim Hee LeeNeurIPS · Harbin Institute of Technology · National University of Singapore
    PDF ↗
  9. 2021
    Learning where to learn: Gradient sparsity in meta and continual learningJohannes von Oswald, Dominic Zhao, Seijin Kobayashi … João SacramentoNeurIPS
    PDF ↗
  10. 2021
    AFEC: Active Forgetting of Negative Transfer in Continual LearningLiyuan Wang, Ming‐Tian Zhang, Zhongfan Jia … Yi ZhongNeurIPS · Tsinghua University · University College London
    PDF ↗
  11. 2021
    Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual LearningDanruo Deng, Guangyong Chen, Jianye Hao … Pheng‐Ann HengNeurIPS · Chinese University of Hong Kong · Shenzhen Institutes of Advanced Technology · +1
    PDF ↗
  12. 2021
    Powerpropagation: A sparsity inducing weight reparameterisationJonathan Schwarz, Siddhant M. Jayakumar, Razvan Pascanu … Yee Whye TehNeurIPS · Google (United States)
    PDF ↗
  13. 2021
    Formalizing the Generalization-Forgetting Trade-off in Continual LearningKrishnan Raghavan, Prasanna BalaprakashNeurIPS · Argonne National Laboratory
    PDF ↗
  14. 2021
    SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental LearningSungmin Cha, Beomyoung Kim, Youngjoon Yoo, Taesup MoonNeurIPS · Sungkyunkwan University · Naver (South Korea) · +1
    PDF ↗
  15. 2021
    Natural continual learning: success is a journey, not (just) a destinationTa-Chu Kao, Kristopher T. Jensen, Gido M. van de Ven … Guillaume HennequinNeurIPS
    PDF ↗
  16. 2021
    Optimizing Reusable Knowledge for Continual Learning via MetalearningJulio Hurtado, Alain Raymond-Sáez, Álvaro SotoNeurIPS · Pontificia Universidad Católica de Chile
    PDF ↗
  17. 2021
    A Procedural World Generation Framework for Systematic Evaluation of Continual LearningTimm Hess, Martin Mundt, Iuliia Pliushch, Visvanathan RameshNeurIPS · Goethe University Frankfurt
    PDF ↗
  18. 2021
    Continual World: A Robotic Benchmark For Continual Reinforcement LearningMaciej Wołczyk, Michał Zając, Razvan Pascanu … Piotr MiłośNeurIPS · Jagiellonian University · Google (United States)
    PDF ↗
  19. 2021
    CAM-GAN: Continual Adaptation Modules for Generative Adversarial NetworksSakshi Varshney, Vinay Kumar Verma, P K Srijith … Piyush RaiNeurIPS
    PDF ↗
  20. 2021
    Firefly Neural Architecture Descent: a General Approach for Growing Neural NetworksLemeng Wu, Bo Liu, Peter Stone, Qiang LiuNeurIPS · The University of Texas at Austin
    PDF ↗
  21. 2021
    Posterior Meta-Replay for Continual LearningChristian Henning, Maria R. Cervera, Francesco D'Angelo … João SacramentoNeurIPS
    PDF ↗
  22. 2021
    Class-Incremental Learning via Dual AugmentationFei Zhu, Zhen Cheng, Xu-Yao Zhang, Cheng-Lin LiuNeurIPS
  23. 2021
  24. 2021
    BNS: Building Network Structures Dynamically for Continual LearningQi Qin, Han Peng, Wen-Rui Hu … Bing LiuNeurIPS
  25. 2021
  26. 2021
    Generative vs. Discriminative: Rethinking The Meta-Continual LearningMohammadamin Banayeeanzade, Rasoul Mirzaiezadeh, Hosein Hasani, Mahdieh SoleymaniNeurIPS
  27. 2021
    Continual Auxiliary Task LearningAuthors pendingNeurIPS
  28. 2021
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.