Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

24 papers of 8,653Sort Recent · Most cited
  1. 2024
    Modality-Inconsistent Continual Learning of Multimodal Large Language ModelsWeiguo Pian, Shijian Deng, Shentong Mo … Yapeng TianTrans. Mach. Learn. Res.
    PDF ↗
  2. 2024
    A unifying framework for generalised Bayesian online learning in non-stationary environmentsGerardo Duràn-Martín, Leandro Sánchez-Betancourt, Alexander Y. Shestopaloff, Kevin MurphyTrans. Mach. Learn. Res.
    PDF ↗
  3. 2024
    Continual Memorization of Factoids in Language ModelsHoward Chen, Jiayi Geng, Adithya Bhaskar … Danqi ChenTrans. Mach. Learn. Res.
    PDF ↗
  4. 2024
    ODEStream: A Buffer-Free Online Learning Framework with ODE-based Adaptor for Streaming Time Series ForecastingFutoon M. Abushaqra, Hao Xue, Yongli Ren, Flora D. SalimTrans. Mach. Learn. Res.
    PDF ↗
  5. 2024
    Towards LifeSpan Cognitive SystemsYu Wang, Chi Han, Tongtong Wu … Julian McAuleyTrans. Mach. Learn. Res.
    PDF ↗
  6. 2024
    Buffer-based Gradient Projection for Continual Federated LearningShenghong Dai, Jy-yong Sohn, Yicong Chen … Kangwook LeeTrans. Mach. Learn. Res.
    PDF ↗
  7. 2024
    Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual LearningMohammadamin Banayeeanzade, Mahdi Soltanolkotabi, Mohammad RostamiTrans. Mach. Learn. Res.
    PDF ↗
  8. 2024PDF ↗
  9. 2024
    Retrospective Feature Estimation for Continual LearningNghia D. Nguyen, Hieu Trung Nguyen, Ang Li … Khoa D. DoanTrans. Mach. Learn. Res.
    PDF ↗
  10. 2024
    Dual-Phase Continual Learning: Supervised Adaptation Meets Unsupervised RetentionVaibhav Singh, Rahaf Aljundi, Eugene BelilovskyTrans. Mach. Learn. Res.
    PDF ↗
  11. 2024
    Federated Class-Incremental Learning with Hierarchical Generative PrototypesRiccardo Salami, Pietro Buzzega, Matteo Mosconi … Simone CalderaraTrans. Mach. Learn. Res.
    PDF ↗
  12. 2024
    AGALE: A Graph-Aware Continual Learning Evaluation FrameworkZhao, Tianqi, Hanjalic, Alan, Khosla, MeghaTrans. Mach. Learn. Res.
    PDF ↗
  13. 2024
    Consistency-Guided Asynchronous Contrastive Tuning for Few-Shot Class-Incremental Tuning of Foundation ModelsShuvendu Roy, Elham Dolatabadi, Arash Afkanpour, Ali EtemadTrans. Mach. Learn. Res.
    PDF ↗
  14. 2024
    Bayesian Learning-driven Prototypical Contrastive Loss for Class-Incremental LearningNisha Lakshmana Raichur, Lucas Heublein, Tobias Feigl … Felix OttTrans. Mach. Learn. Res.
    PDF ↗
  15. 2024
    Continual Learning from Simulated Interactions via Multitask Prospective Rehearsal for Bionic Limb Behavior ModelingSharmita Dey, Benjamin Paassen, Sarath Ravindran Nair … Arndt F. SchillingTrans. Mach. Learn. Res.
    PDF ↗
  16. 2024
    IMEX-Reg: Implicit-Explicit Regularization in the Function Space for Continual LearningPrashant Bhat, Bharath Renjith, Elahe Arani, Bahram ZonoozTrans. Mach. Learn. Res.
    PDF ↗
  17. 2024
    kNN-CLIP: Retrieval Enables Training-Free Segmentation on Continually Expanding Large VocabulariesZhongrui Gui, Shuyang Sun, Runjia Li … Philip H. S. TorrTrans. Mach. Learn. Res.
    PDF ↗
  18. 2024
    A Bag of Tricks for Few-Shot Class-Incremental LearningShuvendu Roy, Chunjong Park, Aldi Fahrezi, Ali EtemadTrans. Mach. Learn. Res.
    PDF ↗
  19. 2024
    Hyperparameters in Continual Learning: a Reality CheckSungmin Cha, Kyunghyun ChoTrans. Mach. Learn. Res.
    PDF ↗
  20. 2024
    Simple and Scalable Strategies to Continually Pre-train Large Language ModelsAdam Ibrahim, Benjamin Therien, Kshitij Gupta … Irina RishTrans. Mach. Learn. Res.
    PDF ↗
  21. 2024
    Personalized Negative Reservoir for Incremental Learning in Recommender SystemsAntonios Valkanas, Yuening Wang, Yingxue Zhang, Mark CoatesTrans. Mach. Learn. Res.
    PDF ↗
  22. 2024
    Investigating Continual Pretraining in Large Language Models: Insights and ImplicationsÇağatay Yıldız, Nishaanth Kanna Ravichandran, Sharma, Nitin … Beyza ErmişTrans. Mach. Learn. Res.
    PDF ↗
  23. 2024
    Concept-Driven Continual LearningSin-Han Yang, Tuomas P. Oikarinen, T. WengTrans. Mach. Learn. Res.
  24. 2024
    Revealing an Overlooked Challenge in Class-Incremental Graph LearningDaiqing Qi, Handong Zhao, Xiaowei Jia, Sheng LiTrans. Mach. Learn. Res.
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.