Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

138 papers of 11,817 · showing 51–100Sort Recent · Most cited
  1. 2021PDF ↗
  2. 2021
    Federated Reconnaissance: Efficient, Distributed, Class-Incremental LearningSean M. Hendryx, Dharma Kc, Bradley Walls, Clayton T. MorrisonarXiv · University of Arizona
    PDF ↗
  3. 2021
    Memory-Free Generative Replay For Class-Incremental LearningXiaomeng Xin, Yiran Zhong, Yunzhong Hou … Liang ZhengarXiv
    PDF ↗
  4. 2021
    How Does Adversarial Fine-Tuning Benefit BERT?Javid Ebrahimi, Hao Yang, Wei ZhangarXiv
    PDF ↗
  5. 2021PDF ↗
  6. 2021
    Continual learning under domain transfer with sparse synaptic burstingShawn Beaulieu, Jeff Clune, Nick CheneyarXiv · University of Vermont
    PDF ↗
  7. 2021PDF ↗
  8. 2021
    A good body is all you need: avoiding catastrophic interference via agent architecture searchJoshua Powers, Ryan Grindle, L. Frati, Josh BongardarXiv · University of Vermont
    PDF ↗
  9. 2021
    Continual Backprop: Stochastic Gradient Descent with Persistent RandomnessShibhansh Dohare, Richard S. Sutton, A. Rupam MahmoodarXiv · University of Alberta
    PDF ↗
  10. 2021
    Lifelong Intent Detection via Multi-Strategy RebalancingQingbin Liu, Xiaoyan Yu, Shizhu He … Jun ZhaoarXiv
    PDF ↗
  11. 2021
    Sequoia: A Software Framework to Unify Continual Learning ResearchFabrice Normandin, Florian Golemo, Oleksiy Ostapenko … M. CacciaarXiv
    PDF ↗
  12. 2021PDF ↗
  13. 2021
    Revisiting Catastrophic Forgetting in Class Incremental LearningZixuan Ni, Haizhou Shi, Siliang Tang … Zhuang, YuetingarXiv · Zhejiang University
    PDF ↗
  14. 2021
    Train on Small, Play the Large: Scaling Up Board Games with AlphaZero and GNNShai Ben-Assayag, Ran El‐YanivarXiv · Technion – Israel Institute of Technology
    PDF ↗
  15. 2021
    AlterSGD: Finding Flat Minima for Continual Learning by Alternative TrainingZhongzhan Huang, Mingfu Liang, Senwei Liang, Wei HearXiv · Purdue University West Lafayette · Nanyang Technological University
    PDF ↗
  16. 2021PDF ↗
  17. 2021
    A Fixed Version of Quadratic Program in Gradient Episodic MemoryWei Zhou, Yiying LiarXiv · National University of Defense Technology
    PDF ↗
  18. 2021
    Improving Human Motion Prediction Through Continual LearningMohammad Samin Yasar, Tariq IqbalarXiv · University of Virginia
    PDF ↗
  19. 2021
    Tackling Catastrophic Forgetting and Background Shift in Continual Semantic SegmentationArthur Douillard, Yifu Chen, Arnaud Dapogny, Matthieu CordarXiv · Valeo (France)
    PDF ↗
  20. 2021
    Few-Shot Domain Expansion for Face Anti-SpoofingBowen Yang, Jing Zhang, Zhenfei Yin, Jing ShaoarXiv
    PDF ↗
  21. 2021
    Task-agnostic Continual Learning with Hybrid Probabilistic ModelsPolina Kirichenko, Mehrdad Farajtabar, Dushyant Rao … Razvan PascanuarXiv
    PDF ↗
  22. 2021
    On the importance of cross-task features for class-incremental learningAlbin Soutif--Cormerais, Marc Masana, Joost van de Weijer, Bartłomiej TwardowskiarXiv
    PDF ↗
  23. 2021PDF ↗
  24. 2021
    A Novel Approach to Lifelong Learning: The Plastic Support StructureGeorges Kanaan, Kai Wen Zheng, Lucas FenauxarXiv · University of Toronto
    PDF ↗
  25. 2021
    Energy Aligning for Biased ModelsBowen Zhao, Chen Chen, Qi Ju, Shu‐Tao XiaarXiv
    PDF ↗
  26. 2021
    Knowing when we do not know: Bayesian continual learning for sensing-based analysis tasksSandra Servia-Rodríguez, Cecilia Mascolo, Young D. KwonarXiv
    PDF ↗
  27. 2021
    ModelCI-e: Enabling Continual Learning in Deep Learning Serving SystemsYizheng Huang, Huaizheng Zhang, Yonggang Wen … Ta Nguyen Binh DuongarXiv
    PDF ↗
  28. 2021
    Solving hybrid machine learning tasks by traversing weight space geodesicsGuruprasad Raghavan, Matt ThomsonarXiv · California Institute of Technology
    PDF ↗
  29. 2021
    Continual Learning in Deep Networks: an Analysis of the Last LayerTimothée Lesort, Thomas George, Irina RisharXiv
    PDF ↗
  30. 2021
    A Consciousness-Inspired Planning Agent for Model-Based Reinforcement LearningMingde Zhao, Zhen Liu, Sitao Luan … Yoshua BengioarXiv · Dalian University of Technology · Université de Montréal · +1
    PDF ↗
  31. 2021
    Personalizing Pre-trained ModelsMina Khan, P. Srivatsa, Advait Rane … Pattie MaesarXiv
    PDF ↗
  32. 2021
    A study on the plasticity of neural networksTudor Berariu, Wojciech Marian Czarnecki, Soham De … Claudia ClopatharXiv · Imperial College London
    PDF ↗
  33. 2021PDF ↗
  34. 2021
    Encoders and Ensembles for Task-Free Continual LearningMurray Shanahan, Christos Kaplanis, Jovana MitrovicarXiv
    PDF ↗
  35. 2021PDF ↗
  36. 2021
    Class-Incremental Few-Shot Object DetectionPengyang Li, Yanan Li, Cui, Han, Wang, DonghuiarXiv
    PDF ↗
  37. 2021
    Shared and Private VAEs with Generative Replay for Continual LearningSubhankar GhosharXiv · Indian Institute of Science Bangalore
    PDF ↗
  38. 2021
    Elastic Weight Consolidation (EWC): Nuts and BoltsAbhishek AicharXiv · University of California, Riverside
    PDF ↗
  39. 2021
    Continual Learning on the Edge with TensorFlow LiteGiorgos Demosthenous, Vassilis VassiliadesarXiv
    PDF ↗
  40. 2021
    A Deep Learning Framework for Lifelong Machine LearningCharles X. Ling, Tanner BohnarXiv · Western University
    PDF ↗
  41. 2021PDF ↗
  42. 2021PDF ↗
  43. 2021
    Dynamic VAEs with Generative Replay for Continual Zero-shot LearningSubhankar GhosharXiv · Indian Institute of Science Bangalore
    PDF ↗
  44. 2021
    Continual Distributed Learning for Crisis ManagementAman Priyanshu, Mudit Sinha, Shreyans MehtaarXiv
    PDF ↗
  45. 2021
    Learning in Deep Neural Networks Using a Biologically Inspired OptimizerGiorgia Dellaferrera, Stanisław Woźniak, Giacomo Indiveri … Evangelos EleftheriouarXiv
    PDF ↗
  46. 2021
    Continual Learning with Fully Probabilistic ModelsBenedikt Pfülb, Alexander Gepperth, Benedikt BagusarXiv · Fulda University of Applied Sciences
    PDF ↗
  47. 2021
    Few-shot Continual Learning: a Brain-inspired ApproachLiyuan Wang, Qian Li, Yi Zhong, Jun ZhuarXiv
    PDF ↗
  48. 2021
    Dynamically Addressing Unseen Rumor via Continual LearningNayeon Lee, Andrea Madotto, Yejin Bang, Pascale FungarXiv · Hong Kong University of Science and Technology
    PDF ↗
  49. 2021
    Unsupervised Class-Incremental Learning Through ConfusionShivam Khare, Kun Cao, James M. RehgarXiv · Georgia Institute of Technology
    PDF ↗
  50. 2021PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.