Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

22 papers of 11,817Sort Recent · Most cited
  1. 2023PDF ↗
  2. 2023
    Metalearning Continual Learning AlgorithmsK. Irie, Róbert Csordás, Jürgen SchmidhuberTrans. Mach. Learn. Res.
    PDF ↗
  3. 2023
    Continual Learning: Applications and the Road ForwardEli Verwimp, S. Ben-David, Matthias Bethge … Gido M. van de VenTrans. Mach. Learn. Res.
    PDF ↗
  4. 2023
    Replay-enhanced Continual Reinforcement LearningTiantian Zhang, K. Shen, Zichuan Lin … Deheng YeTrans. Mach. Learn. Res.
    PDF ↗
  5. 2023
    Online Continual Learning via Logit Adjusted SoftmaxZhehao Huang, Tao Li, Chenhe Yuan … Xiaolin HuangTrans. Mach. Learn. Res.
    PDF ↗
  6. 2023
    Dual Cognitive Architecture: Incorporating Biases and Multi-Memory Systems for Lifelong LearningShruthi Gowda, Bahram Zonooz, Elahe AraniTrans. Mach. Learn. Res.
    PDF ↗
  7. 2023
    Universal Graph Continual LearningT. Hoang, Do Viet Tung, Duy-Hung Nguyen … Hung LeTrans. Mach. Learn. Res.
    PDF ↗
  8. 2023
    Fine-tuning can cripple your foundation model; preserving features may be the solutionJishnu Mukhoti, Y. Gal, Philip H. S. Torr, P. DokaniaTrans. Mach. Learn. Res.
    PDF ↗
  9. 2023
    Continual Learning in Open-vocabulary Classification with Complementary Memory SystemsZhenhai Zhu, Weijie Lyu, Yao Xiao, Derek HoiemTrans. Mach. Learn. Res.
    PDF ↗
  10. 2023
    Continual Adaptation of Vision Transformers for Federated LearningShaunak Halbe, James Smith, Junjiao Tian, Z. KiraTrans. Mach. Learn. Res.
    PDF ↗
  11. 2023
    Overcoming the Stability Gap in Continual LearningMd Yousuf Harun, Christopher KananTrans. Mach. Learn. Res.
    PDF ↗
  12. 2023
    Voyager: An Open-Ended Embodied Agent with Large Language ModelsGuanzhi Wang, Yuqi Xie, Yunfan Jiang … Anima AnandkumarTrans. Mach. Learn. Res.
    PDF ↗
  13. 2023
    Lightweight Learner for Shared Knowledge Lifelong LearningYunhao Ge, Yuecheng Li, Di Wu … L. IttiTrans. Mach. Learn. Res.
    PDF ↗
  14. 2023
    Accelerating Batch Active Learning Using Continual Learning TechniquesArnav Das, Gantavya Bhatt, M. Bhalerao … J. BilmesTrans. Mach. Learn. Res.
    PDF ↗
  15. 2023PDF ↗
  16. 2023
    Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRAJames Smith, Yen-Chang Hsu, Lingyu Zhang … Hongxia JinTrans. Mach. Learn. Res.
    PDF ↗
  17. 2023
    Knowledge Accumulation in Continually Learned Representations and the Issue of Feature ForgettingTimm Hess, Eli Verwimp, Gido M. van de Ven, T. TuytelaarsTrans. Mach. Learn. Res.
    PDF ↗
  18. 2023
    CoDeC: Communication-Efficient Decentralized Continual LearningSakshi Choudhary, Sai Aparna Aketi, Gobinda Saha, Kaushik RoyTrans. Mach. Learn. Res.
    PDF ↗
  19. 2023
    SIESTA: Efficient Online Continual Learning with SleepMd Yousuf Harun, Jhair Gallardo, Tyler L. Hayes … Christopher KananTrans. Mach. Learn. Res.
    PDF ↗
  20. 2023
    Continual HyperTransformer: A Meta-Learner for Continual Few-Shot LearningMax Vladymyrov, A. Zhmoginov, M. SandlerTrans. Mach. Learn. Res.
    PDF ↗
  21. 2023
    Improving Continual Learning by Accurate Gradient Reconstructions of the PastErik Daxberger, S. Swaroop, Kazuki Osawa … Mohammad Emtiyaz KhanTrans. Mach. Learn. Res.
  22. 2023
    Meta Continual Learning on Graphs with Experience ReplayAltay Unal, A. Akgül, M. Kandemir, Gozde UnalTrans. Mach. Learn. Res.
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.