Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

91 papers of 8,653 · showing 51–91Sort Recent · Most cited
  1. 2024
    Continual Learning from Simulated Interactions via Multitask Prospective Rehearsal for Bionic Limb Behavior ModelingSharmita Dey, Benjamin Paassen, Sarath Ravindran Nair … Arndt F. SchillingTrans. Mach. Learn. Res.
    PDF ↗
  2. 2024
    IMEX-Reg: Implicit-Explicit Regularization in the Function Space for Continual LearningPrashant Bhat, Bharath Renjith, Elahe Arani, Bahram ZonoozTrans. Mach. Learn. Res.
    PDF ↗
  3. 2024
    kNN-CLIP: Retrieval Enables Training-Free Segmentation on Continually Expanding Large VocabulariesZhongrui Gui, Shuyang Sun, Runjia Li … Philip H. S. TorrTrans. Mach. Learn. Res.
    PDF ↗
  4. 2024
    A Bag of Tricks for Few-Shot Class-Incremental LearningShuvendu Roy, Chunjong Park, Aldi Fahrezi, Ali EtemadTrans. Mach. Learn. Res.
    PDF ↗
  5. 2024
    Hyperparameters in Continual Learning: a Reality CheckSungmin Cha, Kyunghyun ChoTrans. Mach. Learn. Res.
    PDF ↗
  6. 2024
    Simple and Scalable Strategies to Continually Pre-train Large Language ModelsAdam Ibrahim, Benjamin Therien, Kshitij Gupta … Irina RishTrans. Mach. Learn. Res.
    PDF ↗
  7. 2024
    Personalized Negative Reservoir for Incremental Learning in Recommender SystemsAntonios Valkanas, Yuening Wang, Yingxue Zhang, Mark CoatesTrans. Mach. Learn. Res.
    PDF ↗
  8. 2024
    Investigating Continual Pretraining in Large Language Models: Insights and ImplicationsÇağatay Yıldız, Nishaanth Kanna Ravichandran, Sharma, Nitin … Beyza ErmişTrans. Mach. Learn. Res.
    PDF ↗
  9. 2024
    Concept-Driven Continual LearningSin-Han Yang, Tuomas P. Oikarinen, T. WengTrans. Mach. Learn. Res.
  10. 2024
    Revealing an Overlooked Challenge in Class-Incremental Graph LearningDaiqing Qi, Handong Zhao, Xiaowei Jia, Sheng LiTrans. Mach. Learn. Res.
  11. 2023
    Read Between the Layers: Leveraging Intra-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained ModelsKyra Ahrens, Hans Hergen Lehmann, Jae Hee Lee, Stefan WermterTrans. Mach. Learn. Res.
    PDF ↗
  12. 2023
    Metalearning Continual Learning AlgorithmsKazuki Irie, Róbert Csordás, Jürgen SchmidhuberTrans. Mach. Learn. Res.
    PDF ↗
  13. 2023
    Continual Learning: Applications and the Road ForwardEli Verwimp, Rahaf Aljundi, Shai Ben-David … Gido M. van de VenTrans. Mach. Learn. Res.
    PDF ↗
  14. 2023
    Replay-enhanced Continual Reinforcement LearningTiantian Zhang, Kevin Shen, Zichuan Lin … Deheng YeTrans. Mach. Learn. Res.
    PDF ↗
  15. 2023
    Online Continual Learning via Logit Adjusted SoftmaxZhehao Huang, Tao Li, Chenhe Yuan … Xiaolin HuangTrans. Mach. Learn. Res.
    PDF ↗
  16. 2023
    Dual Cognitive Architecture: Incorporating Biases and Multi-Memory Systems for Lifelong LearningShruthi Gowda, Bahram Zonooz, Elahe AraniTrans. Mach. Learn. Res.
    PDF ↗
  17. 2023
    Universal Graph Continual LearningThanh D. Hoang, Do Viet Tung, Duy‐Hung Nguyen … Hung LêTrans. Mach. Learn. Res.
    PDF ↗
  18. 2023
    Fine-tuning can cripple your foundation model; preserving features may be the solutionJishnu Mukhoti, Yarin Gal, Philip H. S. Torr, Puneet K. DokaniaTrans. Mach. Learn. Res.
    PDF ↗
  19. 2023
    Continual Learning in Open-vocabulary Classification with Complementary Memory SystemsZhen Zhu, Weijie Lyu, Yao Xiao, Derek HoiemTrans. Mach. Learn. Res.
    PDF ↗
  20. 2023
    Continual Adaptation of Vision Transformers for Federated LearningShaunak Halbe, Smith, James Seale, Junjiao Tian, Zsolt KiraTrans. Mach. Learn. Res.
    PDF ↗
  21. 2023
    ***FastDoc***: Domain-Specific Fast Continual Pre-training Technique using Document-Level Metadata and TaxonomyAbhilash Nandy, Manav Nitin, Kapadnis … Niloy GangulyTrans. Mach. Learn. Res.
    PDF ↗
  22. 2023
    Overcoming the Stability Gap in Continual LearningMd Yousuf Harun, Christopher KananTrans. Mach. Learn. Res.
    PDF ↗
  23. 2023
    Voyager: An Open-Ended Embodied Agent with Large Language ModelsGuanzhi Wang, Yuqi Xie, Yunfan Jiang … Anima AnandkumarTrans. Mach. Learn. Res.
    PDF ↗
  24. 2023
    Lightweight Learner for Shared Knowledge Lifelong LearningYunhao Ge, Yuecheng Li, Di Wu … Laurent IttiTrans. Mach. Learn. Res.
    PDF ↗
  25. 2023
    Accelerating Batch Active Learning Using Continual Learning TechniquesArnav Das, Gantavya Bhatt, Megh Manoj Bhalerao … Jeff BilmesTrans. Mach. Learn. Res.
    PDF ↗
  26. 2023PDF ↗
  27. 2023
    Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRASmith, James Seale, Yen-Chang Hsu, Lingyu Zhang … Hongxia JinTrans. Mach. Learn. Res.
    PDF ↗
  28. 2023
    Knowledge Accumulation in Continually Learned Representations and the Issue of Feature ForgettingTimm Hess, Eli Verwimp, Gido M. van de Ven, Tinne TuytelaarsTrans. Mach. Learn. Res.
    PDF ↗
  29. 2023
    CoDeC: Communication-Efficient Decentralized Continual LearningSakshi Choudhary, Sai Aparna Aketi, Gobinda Saha, Kaushik RoyTrans. Mach. Learn. Res.
    PDF ↗
  30. 2023
    SIESTA: Efficient Online Continual Learning with SleepMd Yousuf Harun, Jhair Gallardo, Tyler L. Hayes … Christopher KananTrans. Mach. Learn. Res.
    PDF ↗
  31. 2023
    Continual HyperTransformer: A Meta-Learner for Continual Few-Shot LearningMax Vladymyrov, Andrey Zhmoginov, M. SandlerTrans. Mach. Learn. Res.
    PDF ↗
  32. 2023
    Improving Continual Learning by Accurate Gradient Reconstructions of the PastErik Daxberger, S. Swaroop, Kazuki Osawa … Mohammad Emtiyaz KhanTrans. Mach. Learn. Res.
  33. 2023
    Meta Continual Learning on Graphs with Experience ReplayAltay Unal, A. Akgül, M. Kandemir, Gozde UnalTrans. Mach. Learn. Res.
  34. 2022
    Lifelong Reinforcement Learning with Modulating MasksEseoghene Ben-Iwhiwhu, Saptarshi Nath, Praveen K. Pilly … Andrea SoltoggioTrans. Mach. Learn. Res.
    PDF ↗
  35. 2022
    Continual Learning by Modeling Intra-Class VariationLonghui Yu, Tianyang Hu, Lanqing Hong … Weiyang LiuTrans. Mach. Learn. Res.
    PDF ↗
  36. 2022
    Learn the Time to Learn: Replay Scheduling in Continual LearningMarcus Klasson, Hedvig Kjellström, Cheng ZhangTrans. Mach. Learn. Res.
    PDF ↗
  37. 2022
    Centroids Matching: an efficient Continual Learning approach operating in the embedding spaceJary Pomponi, Simone Scardapane, Aurelio UnciniTrans. Mach. Learn. Res.
    PDF ↗
  38. 2022PDF ↗
  39. 2022
    Queried Unlabeled Data Improves and Robustifies Class-Incremental LearningTianlong Chen, Sijia Liu, Shiyu Chang … Wang, ZhangyangTrans. Mach. Learn. Res.
    PDF ↗
  40. 2022
    Memory-efficient Reinforcement Learning with Value-based Knowledge ConsolidationQingfeng Lan, Yangchen Pan, Jun Luo, A. Rupam MahmoodTrans. Mach. Learn. Res.
    PDF ↗
  41. 2022
    Mitigating Catastrophic Forgetting in Spiking Neural Networks through Threshold ModulationIlyass Hammouamri, T. Masquelier, Dennis G. WilsonTrans. Mach. Learn. Res.
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.