Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3051–3100Sort Recent · Most cited
  1. 2023
    Restricted Orthogonal Gradient Projection for Continual LearningZeyuan Yang, Zonghan Yang, Peng Li, Yang LiuAI Open
    PDF ↗
  2. 2023PDF ↗
  3. 2023PDF ↗
  4. 2023
    Class-Incremental Learning with RepetitionHamed Hemati, Andrea Cossu, Antonio Carta … Damian BorthCoLLAs
    PDF ↗
  5. 2023
    Graph Lifelong Learning: A SurveyFalih Gozi Febrinanto, Feng Xia, Kristen Moore … Charu C. AggarwalIEEE Computational Intelligence Magazine · Federation University · Commonwealth Scientific and Industrial Research Organisation · +1
    PDF ↗
  6. 2023
    DEJA VU: Continual Model Generalization For Unseen DomainsChenxi Liu, Lixu Wang, Lingjuan Lyu … Qi ZhuICLR
    PDF ↗
  7. 2022
    Probabilistic Bilevel Coreset SelectionXiaofang Zhou, Renjie Pi, Weizhong Zhang … Tong ZhangICML
    PDF ↗
  8. 2023
    Multi-lingual agents through multi-headed neural networksJonathan D. Thomas, Ra ́ul Santos-Rodr ́ıguez, Mihai Anca, Robert J. PiechockiNorthern Lights Deep Learning Workshop · University of Bristol
    PDF ↗
  9. 2023PDF ↗
  10. 2020
    A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World LearningMartin Mundt, Yongwon Hong, Iuliia Pliushch, Visvanathan RameshNeural Networks · Goethe University Frankfurt · Technische Universität Darmstadt · +1
    PDF ↗
  11. 2023
    Continual task learning in natural and artificial agentsTimo Flesch, Andrew Saxe, Christopher SummerfieldTrends in Neurosciences · University of Oxford · Sainsbury Laboratory · +3
    PDF ↗
  12. 2023
    A Domain-Agnostic Approach for Characterization of Lifelong Learning SystemsMegan M. Baker, Alexander New, Mario Aguilar-Simon … Gautam K. VallabhaNeural Networks · Johns Hopkins University Applied Physics Laboratory · Teledyne Technologies (United States) · +13
    PDF ↗
  13. 2023
    Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signalsTimo Flesch, Dávid Nagy, Andrew Saxe, Christopher SummerfieldPLOS · University of Oxford · HUN-REN Wigner Research Centre for Physics · +5
    PDF ↗
  14. 2023
    Artificial Neuronal Ensembles with Learned Context Dependent GatingM. J. Tilley, Michelle Miller, David A. FreedmanICLR
    PDF ↗
  15. 2023
    Sim-Anchored Learning for On-the-Fly AdaptationBassel El Mabsout, Shahin Roozkhosh, Siddharth Mysore … Renato MancusoarXiv
    PDF ↗
  16. 2023PDF ↗
  17. 2023
    Self-recovery of memory via generative replayZhenglong Zhou, Geshi Yeung, Anna C. SchapiroarXiv
    PDF ↗
  18. 2021
    RMM: Reinforced Memory Management for Class-Incremental LearningYaoyao Liu, Bernt Schiele, Qianru SunNeurIPS
    PDF ↗
  19. 2023
    Continual prune-and-select: class-incremental learning with specialized subnetworksAleksandr Dekhovich, David M. J. Tax, Marcel H. F. Sluiter, Miguel A. BessaApplied Intelligence · Delft University of Technology · Brown University
    PDF ↗
  20. 2023
    On-device synaptic memory consolidation using Fowler-Nordheim quantum-tunnelingMustafizur Rahman, Subhankar Bose, Shantanu ChakrabarttyFrontiers · Washington University in St. Louis
    PDF ↗
  21. 2023PDF ↗
  22. 2024PDF ↗
  23. 2023
    A Distinct Unsupervised Reference Model From The Environment Helps Continual LearningSeyyed AmirHossein Ameli Kalkhoran, Mohammadamin Banayeeanzade, Mahdi Samiei, Mahdieh Soleymani BaghshaharXiv
    PDF ↗
  24. 2023
    Damage Control During Domain Adaptation for Transducer Based Automatic Speech RecognitionSomshubra Majumdar, Shantanu Acharya, Vitaly Lavrukhin, Boris GinsburgIEEE Spoken Language Technology Workshop (SLT)
    PDF ↗
  25. 2023
    On the challenges to learn from Natural Data StreamsGuido Borghi, Gabriele Graffieti, Davide MaltoniarXiv
    PDF ↗
  26. 2023
    Architect, Regularize and Replay (ARR): a Flexible Hybrid Approach for Continual LearningVincenzo Lomonaco, Lorenzo Pellegrini, Gabriele Graffieti, Davide MaltoniarXiv
    PDF ↗
  27. 2023
    Generative appearance replay for continual unsupervised domain adaptationBoqi Chen, Kevin Thandiackal, Pushpak Pati, O. GokselMedical Image Anal.
    PDF ↗
  28. 2023
    Dynamically Modular and Sparse General Continual LearningArnav Varma, Elahe Arani, Bahram ZonoozVISIGRAPP
    PDF ↗
  29. 2023
    FeTrIL: Feature Translation for Exemplar-Free Class-Incremental LearningGrégoire Petit, Adrian Popescu, Hugo Schindler … Bertrand DelezoideWACV · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +3
    PDF ↗
  30. 2023
    A Continual Deepfake Detection Benchmark: Dataset, Methods, and EssentialsChuqiao Li, Zhiwu Huang, Danda Pani Paudel … Luc Van GoolWACV · Singapore Management University · Xi'an Jiaotong University · +2
    PDF ↗
  31. 2023
    Memorizing Complementation Network for Few-Shot Class-Incremental LearningZhong Ji, Zhishen Hou, Xiyao Liu … Xuelong LiTIP · Tianjin University · Shenyang Institute of Automation · +2
    PDF ↗
  32. 2023
    Rehearsal-free Continual Language Learning via Efficient Parameter IsolationZhicheng Wang, Yufang Liu, Tao Ji … Wenqiu ZengACL · East China Normal University · China Institute of Finance and Capital Markets
    PDF ↗
  33. 2023
    Continual SLAM: Beyond Lifelong Simultaneous Localization and Mapping through Continual LearningNiclas Vödisch, Daniele Cattaneo, Wolfram Burgard, Abhinav ValadaSpringer · University of Freiburg · University of Technology Nuremberg
    PDF ↗
  34. 2023
    PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement LearningHojoon Lee, Jaegul Choo, Hyunseung Kim … Chulhee YunNeurIPS
    PDF ↗
  35. 2023
    Improving Gender Fairness of Pre-Trained Language Models without Catastrophic ForgettingZahra Fatemi, Xing Chen, Wenhao Liu, Caimming XiongACL · University of Illinois Chicago · University of Chicago · +1
    PDF ↗
  36. 2023
    Consistent Prototype Learning for Few-Shot Continual Relation ExtractionXiudi Chen, Hui Wu, Xiaodong ShiACL · Xiamen University
    PDF ↗
  37. 2023
    Do Pre-trained Models Benefit Equally in Continual Learning?Kuan-Ying Lee, Yuanyi Zhong, Yu-Xiong WangWACV · University of Illinois Urbana-Champaign
    PDF ↗
  38. 2023
    Attribution-aware Weight Transfer: A Warm-Start Initialization for Class-Incremental Semantic SegmentationDipam Goswami, René Schuster, Joost van de Weijer, Didier StrickerWACV · German Research Centre for Artificial Intelligence · Birla Institute of Technology and Science, Pilani · +2
    PDF ↗
  39. 2023
    Saliency Guided Experience Packing for Replay in Continual LearningGobinda Saha, Kaushik RoyWACV · Purdue University West Lafayette
    PDF ↗
  40. 2023
    Large-scale Lifelong Learning of In-context Instructions and How to Tackle ItJisoo Mok, Jaeyoung Do, Sung‐Jin Lee … Sungroh YoonACL · Seoul National University · New Generation University College · +4
    PDF ↗
  41. 2023
    InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction TuningSamuel Cahyawijaya, Holy Lovenia, Tiezheng Yu … Pascale FungFirst Workshop in South East Asian Language Processing · Hong Kong University of Science and Technology · Red Cross Hospital
    PDF ↗
  42. 2023
    Knowledge Transfer in Incremental Learning for Multilingual Neural Machine TranslationKaiyu Huang, Peng Li, Jin Ma … Yang LiuACL · Tsinghua University · Beijing Academy of Artificial Intelligence · +5
    PDF ↗
  43. 2023
    Learning “O” Helps for Learning More: Handling the Unlabeled Entity Problem for Class-incremental NERRuotian Ma, Xuanting Chen, Lin Zhang … Yun Wen ChenACL · Fudan University · Wanfang Data (China)
    PDF ↗
  44. 2023
    Continual Learning with Dependency Preserving HypernetworksDupati Srikar Chandra, Sakshi Varshney, P. K. Srijith, Sunil GuptaWACV · Indian Institute of Technology Hyderabad · Deakin University
    PDF ↗
  45. 2023PDF ↗
  46. 2023
    Cross-lingual Continual LearningMeryem M’hamdi, Xiang Ren, Jonathan MayACL · University of Southern California · California Southern University
    PDF ↗
  47. 2023
    Continual Learning for Multilingual Neural Machine Translation via Dual Importance-based Model DivisionJunpeng Liu, Kaiyu Huang, Hao Yu … Degen HuangEMNLP · Dalian University of Technology · Tsinghua University · +1
    PDF ↗
  48. 2023
    Neural Weight Search for Scalable Task Incremental LearningJiang Jian, Oya ÇeliktutanWACV · King's College London
    PDF ↗
  49. 2023PDF ↗
  50. 2023
    Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse NetworksGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiySpringer LNCS · Eindhoven University of Technology · University of Twente
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.