Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3001–3050Sort Recent · Most cited
  1. 2023
    Continual Learning in the Presence of Spurious CorrelationDong-Gyu Lee, Sangwon Jung, Taesup MoonarXiv
    PDF ↗
  2. 2023
    Sparse Distributed Memory is a Continual LearnerTrenton Bricken, Xander Davies, Deepak Singh … Gabriel KreimanICLR
    PDF ↗
  3. 2023
    SIESTA: Efficient Online Continual Learning with SleepMd Yousuf Harun, Jhair Gallardo, Tyler L. Hayes … Christopher KananTMLR
    PDF ↗
  4. 2023
    Fixed Design Analysis of Regularization-Based Continual LearningHaoran Li, Jingfeng Wu, Vladimir BravermanCoLLAs
    PDF ↗
  5. 2023
    CSSL-MHTR: Continual Self-Supervised Learning for Scalable Multi-script Handwritten Text RecognitionMarwa Dhiaf, Mohamed Ali Souibgui, Kai Wang … Ahmed Cheikh RouhouarXiv
    PDF ↗
  6. 2023
    Replay Buffer with Local Forgetting for Adapting to Local Environment Changes in Deep Model-Based Reinforcement LearningAli Rahimi-Kalahroudi, Janarthanan Rajendran, Ida Momennejad … Sarath ChandarCoLLAs
    PDF ↗
  7. 2021
    Continual Learning of Generative Models With Limited Data: From Wasserstein-1 Barycenter to Adaptive CoalescenceMehmet Dedeoğlu, Sen Lin, Zhaofeng Zhang, Junshan ZhangTNNLS · Arizona State University · The Ohio State University · +1
    PDF ↗
  8. 2023
    Is forgetting less a good inductive bias for forward transfer?Jiefeng Chen, Timothy Nguyen, Dilan Görür, Arslan ChaudhryICLR
    PDF ↗
  9. 2023PDF ↗
  10. 2023PDF ↗
  11. 2023
    Loss of Plasticity in Continual Deep Reinforcement LearningZaheer Abbas, Rosie Zhao, Joseph Modayil … Marlos C. MachadoCoLLAs
    PDF ↗
  12. 2024
    PromptFusion: Decoupling Stability and Plasticity for Continual LearningHao Chen, Zuxuan Wu, Xintong Han … Yu–Gang JiangECCV
    PDF ↗
  13. 2023
    Continual Visual Reinforcement Learning with A Life-Long World ModelMin-Ting Pan, Wendong Zhang, Geng Chen … Xiaokang YangECML/PKDD
    PDF ↗
  14. 2023
    Dynamic Y-KD: A Hybrid Approach to Continual Instance SegmentationMathieu Pagé-Fortin, Brahim Chaib-draaarXiv
    PDF ↗
  15. 2023PDF ↗
  16. 2021
    Prototype-Guided Memory Replay for Continual LearningStella Ho, Ming Liu, Lan Du … Yong XiangTNNLS · Deakin University · Monash University · +1
    PDF ↗
  17. 2023
    Understanding plasticity in neural networksClare Lyle, Zeyu Zheng, Evgenii Nikishin … Will DabneyICML
    PDF ↗
  18. 2023PDF ↗
  19. 2023PDF ↗
  20. 2023
    Adapter Incremental Continual Learning of Efficient Audio Spectrogram TransformersNithish Muthuchamy Selvaraj, Xiaobao Guo, Adams Wai‐Kin Kong … Alex C. KotInterspeech
    PDF ↗
  21. 2023
    InOR-Net: Incremental 3-D Object Recognition Network for Point Cloud RepresentationJiahua Dong, Yang Cong, Gan Sun … Ender KonukoğluTNNLS · Shenyang Institute of Automation · Chinese Academy of Sciences · +4
    PDF ↗
  22. 2023
    Knowledge Restore and Transfer for Multi-Label Class-Incremental LearningSonglin Dong, Haoyu Luo, Yuhang He … Gong, YihongICCV
    PDF ↗
  23. 2023
    Improving Representational Continuity via Continued PretrainingMichael Sun, Ananya Kumar, Divyam Madaan, Percy LiangarXiv
    PDF ↗
  24. 2023
    Better Generative Replay for Continual Federated LearningDaiqing Qi, Handong Zhao, Sheng LiICLR
    PDF ↗
  25. 2023PDF ↗
  26. 2023
    Unbiased and Efficient Self-Supervised Incremental Contrastive LearningCheng Ji, Jianxin Li, Hao Peng … Philip S. YuWSDM · Beihang University · Macquarie University · +1
    PDF ↗
  27. 2023
    New Insights for the Stability-Plasticity Dilemma in Online Continual LearningDahuin Jung, Dongjin Lee, Sunwon Hong … Sungroh YoonICLR
    PDF ↗
  28. 2023PDF ↗
  29. 2023PDF ↗
  30. 2023
    Task-Specific Skill Localization in Fine-tuned Language ModelsAbhishek Panigrahi, Nikunj Saunshi, Haoyu Zhao, Sanjeev AroraICML
    PDF ↗
  31. 2023
    Theory on Forgetting and Generalization of Continual LearningSen Lin, Peizhong Ju, Yingbin Liang, Ness B. ShroffICML
    PDF ↗
  32. 2023PDF ↗
  33. 2023
    Emphasizing Unseen Words: New Vocabulary Acquisition for End-to-End Speech RecognitionLeyuan Qu, Cornelius Weber, Stefan WermterNeural Networks · Universität Hamburg · Zhejiang Lab · +2
    PDF ↗
  34. 2023
    Continual Pre-training of Language ModelsZixuan Ke, Yijia Shao, Haowei Lin … Bing LiuICLR
    PDF ↗
  35. 2023
    Exploring the Benefits of Training Expert Language Models over Instruction TuningJoel Jang, Seungone Kim, Seonghyeon Ye … Minjoon SeoICML
    PDF ↗
  36. 2024PDF ↗
  37. 2023PDF ↗
  38. 2023
    Efficient Parametric Approximations of Neural Network Function Space DistanceNikita Dhawan, Sicong Huang, Juhan Bae, Roger GrosseICML
    PDF ↗
  39. 2023PDF ↗
  40. 2023PDF ↗
  41. 2023
    SuperFormer: Continual learning superposition method for text classificationMarko Zeman, Jana Faganeli Pucer, Igor Kononenko, Zoran BosnićNeural Networks · University of Ljubljana
    PDF ↗
  42. 2025
    Online Reinforcement Learning in Non-Stationary Context-Driven EnvironmentsPouya Hamadanian, Arash Nasr-Esfahany, Malte Schwarzkopf … Mohammad AlizadehICLR
    PDF ↗
  43. 2023
    SATS: Self-Attention Transfer for Continual Semantic SegmentationYiqiao Qiu, Yixing Shen, Zhuohao Sun … Ruixuan WangPattern Recognition · Sun Yat-sen University · Wuhan University · +2
    PDF ↗
  44. 2023PDF ↗
  45. 2023
    Avalanche: A PyTorch Library for Deep Continual LearningAntonio Carta, Lorenzo Pellegrini, Andrea Cossu … Vincenzo LomonacoJMLR
    PDF ↗
  46. 2023
    Neuro Symbolic Continual Learning: Knowledge, Reasoning Shortcuts and Concept RehearsalEmanuele Marconato, Gianpaolo Bontempo, Elisa Ficarra … Stefano TesoICML
    PDF ↗
  47. 2023PDF ↗
  48. 2023
    Towards Label-Efficient Incremental Learning: A SurveyMert Kilickaya, Joost van de Weijer, Yuki M. AsanoarXiv
    PDF ↗
  49. 2023
    Utilizing Priming to Identify Optimal Class Ordering to Alleviate Catastrophic ForgettingGabriel Mantione-Holmes, Justin Leo, Jugal KalitaIEEE 17th International Conference on Semantic Computing… · Lewis & Clark College · University of Colorado Boulder · +2
    PDF ↗
  50. 2023
    Progressive Prompts: Continual Learning for Language ModelsAnastasia Razdaibiedina, Yuning Mao, Rui Hou … Amjad AlmahairiICLR
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.