Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

23 papers of 11,817Sort Recent · Most cited
  1. 2024PDF ↗
  2. 2024
    Modality-Inconsistent Continual Learning of Multimodal Large Language ModelsWeiguo Pian, Shijian Deng, Shentong Mo … Yapeng TianTrans. Mach. Learn. Res.
    PDF ↗
  3. 2024
    A unifying framework for generalised Bayesian online learning in non-stationary environmentsGerardo Duran-Martin, Leandro Sánchez-Betancourt, Alexander Y. Shestopaloff, Kevin MurphyTrans. Mach. Learn. Res.
    PDF ↗
  4. 2024
    Continual Memorization of Factoids in Language ModelsHoward Chen, Jia-Yi Geng, Adithya Bhaskar … Danqi ChenTrans. Mach. Learn. Res.
    PDF ↗
  5. 2024
    ODEStream: A Buffer-Free Online Learning Framework with ODE-based Adaptor for Streaming Time Series ForecastingFutoon M. Abushaqra, Hao Xue, Yongli Ren, F. SalimTrans. Mach. Learn. Res.
    PDF ↗
  6. 2024
    Towards LifeSpan Cognitive SystemsYu Wang, Chi Han, Tongtong Wu … Julian McAuleyTrans. Mach. Learn. Res.
    PDF ↗
  7. 2024
    Buffer-based Gradient Projection for Continual Federated LearningShenghong Dai, Yicong Chen, Jy-yong Sohn … Kangwook LeeTrans. Mach. Learn. Res.
    PDF ↗
  8. 2024
    Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual LearningMohammadamin Banayeeanzade, Mahdi Soltanolkotabi, Mohammad RostamiTrans. Mach. Learn. Res.
    PDF ↗
  9. 2024PDF ↗
  10. 2024
    Retrospective Feature Estimation for Continual LearningNghia Nguyen, Hieu Trung Nguyen, Ang Li … Khoa D. DoanTrans. Mach. Learn. Res.
    PDF ↗
  11. 2024
    Dual-Phase Continual Learning: Supervised Adaptation Meets Unsupervised RetentionVaibhav Singh, Rahaf Aljundi, Eugene BelilovskyTrans. Mach. Learn. Res.
    PDF ↗
  12. 2024
    Federated Class-Incremental Learning with Hierarchical Generative PrototypesRiccardo Salami, Pietro Buzzega, Matteo Mosconi … S. CalderaraTrans. Mach. Learn. Res.
    PDF ↗
  13. 2024
    AGALE: A Graph-Aware Continual Learning Evaluation FrameworkTianqi Zhao, A. Hanjalic, Megha KhoslaTrans. Mach. Learn. Res.
    PDF ↗
  14. 2024
    Consistency-Guided Asynchronous Contrastive Tuning for Few-Shot Class-Incremental Tuning of Foundation ModelsShuvendu Roy, Elham Dolatabadi, Arash Afkanpour, Ali EtemadTrans. Mach. Learn. Res.
    PDF ↗
  15. 2024
    Bayesian Learning-driven Prototypical Contrastive Loss for Class-Incremental LearningN. Raichur, Lucas Heublein, Tobias Feigl … Felix OttTrans. Mach. Learn. Res.
    PDF ↗
  16. 2024
    IMEX-Reg: Implicit-Explicit Regularization in the Function Space for Continual LearningP. Bhat, Bharath Renjith, Elahe Arani, Bahram ZonoozTrans. Mach. Learn. Res.
    PDF ↗
  17. 2024
    kNN-CLIP: Retrieval Enables Training-Free Segmentation on Continually Expanding Large VocabulariesZhongrui Gui, Shuyang Sun, Runjia Li … Philip H. S. TorrTrans. Mach. Learn. Res.
    PDF ↗
  18. 2024
    A Bag of Tricks for Few-Shot Class-Incremental LearningShuvendu Roy, Chunjong Park, Aldi Fahrezi, Ali EtemadTrans. Mach. Learn. Res.
    PDF ↗
  19. 2024
    Hyperparameters in Continual Learning: a Reality CheckSungmin Cha, Kyunghyun ChoTrans. Mach. Learn. Res.
    PDF ↗
  20. 2024
    Simple and Scalable Strategies to Continually Pre-train Large Language ModelsAdam Ibrahim, Benjamin Th'erien, Kshitij Gupta … Irina RishTrans. Mach. Learn. Res.
    PDF ↗
  21. 2024
    Investigating Continual Pretraining in Large Language Models: Insights and ImplicationsÇağatay Yıldız, Nishaanth Kanna Ravichandran, Nitin Sharma … B. Ermi̇şTrans. Mach. Learn. Res.
    PDF ↗
  22. 2024
    Concept-Driven Continual LearningSin-Han Yang, Tuomas P. Oikarinen, T. WengTrans. Mach. Learn. Res.
  23. 2024
    Revealing an Overlooked Challenge in Class-Incremental Graph LearningDaiqing Qi, Handong Zhao, Xiaowei Jia, Sheng LiTrans. Mach. Learn. Res.
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.