Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

40 papers of 11,817Sort Recent · Most cited
  1. 2023
    TiC-CLIP: Continual Training of CLIP ModelsSaurabh Garg, Mehrdad Farajtabar, Hadi Pouransari … Fartash FaghriICLR
    PDF ↗
  2. 2023
    How connectivity structure shapes rich and lazy learning in neural circuitsY. Liu, A. Baratin, Jonathan Cornford … Guillaume LajoieICLR
    PDF ↗
  3. 2023
    TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained ModelsZuxin Liu, Jesse Zhang, Kavosh Asadi … Rasool FakoorICLR
    PDF ↗
  4. 2023
    TRAM: Bridging Trust Regions and Sharpness Aware MinimizationTom Sherborne, Naomi Saphra, Pradeep Dasigi, Hao PengICLR
    PDF ↗
  5. 2023
    Class Incremental Learning via Likelihood Ratio Based Task PredictionHaowei Lin, Yijia Shao, W. Qian … Bing LiuICLR
    PDF ↗
  6. 2023PDF ↗
  7. 2023
    Understanding Catastrophic Forgetting in Language Models via Implicit InferenceSuhas Kotha, Jacob Mitchell Springer, Aditi RaghunathanICLR
    PDF ↗
  8. 2023PDF ↗
  9. 2023
    Progressive Fourier Neural Representation for Sequential Video CompilationHaeyong Kang, Dahyun Kim, Jaehong Yoon … C. D. YooICLR
    PDF ↗
  10. 2023
    Kalman Filter for Online Classification of Non-Stationary DataMichalis K. Titsias, Alexandre Galashov, Amal Rannen-Triki … J. BornscheinICLR
    PDF ↗
  11. 2023
    A Probabilistic Framework for Modular Continual LearningL. Valkov, Akash Srivastava, Swarat Chaudhuri, Charles SuttonICLR
    PDF ↗
  12. 2023
    ViDA: Homeostatic Visual Domain Adapter for Continual Test Time AdaptationJiaming Liu, Senqiao Yang, Peidong Jia … Shanghang ZhangICLR
    PDF ↗
  13. 2023PDF ↗
  14. 2023PDF ↗
  15. 2023
    Prediction Error-based Classification for Class-Incremental LearningMichal Zajkac, T. Tuytelaars, Gido M. van de VenICLR
    PDF ↗
  16. 2023
    A Stable and Scalable Method for Solving Initial Value PDEs with Neural NetworksMarc Finzi, Andres Potapczynski, M. Choptuik, A. WilsonICLR
    PDF ↗
  17. 2023
    Towards Open Temporal Graph Neural NetworksKaituo Feng, Changsheng Li, Xiaolu Zhang, Jun ZhouICLR
    PDF ↗
  18. 2023
    Sparse Distributed Memory is a Continual LearnerTrenton Bricken, Xander Davies, Deepak Singh … G. KreimanICLR
    PDF ↗
  19. 2023
    Is forgetting less a good inductive bias for forward transfer?Jiefeng Chen, Timothy Nguyen, Dilan Gorur, Arslan ChaudhryICLR
    PDF ↗
  20. 2023PDF ↗
  21. 2023
    Better Generative Replay for Continual Federated LearningDaiqing Qi, Handong Zhao, Sheng LiICLR
    PDF ↗
  22. 2023
    New Insights for the Stability-Plasticity Dilemma in Online Continual LearningDahuin Jung, Dongjin Lee, Sunwon Hong … Sungroh YoonICLR
    PDF ↗
  23. 2023PDF ↗
  24. 2023PDF ↗
  25. 2023
    Continual Pre-training of Language ModelsZixuan Ke, Yijia Shao, Haowei Lin … Bin LiuICLR
    PDF ↗
  26. 2023PDF ↗
  27. 2023
    Online Reinforcement Learning in Non-Stationary Context-Driven EnvironmentsPouya Hamadanian, Arash Nasr-Esfahany, Malte Schwarzkopf … MohammadIman AlizadehICLR
    PDF ↗
  28. 2023
    Progressive Prompts: Continual Learning for Language ModelsAnastasia Razdaibiedina, Yuning Mao, Rui Hou … Amjad AlmahairiICLR
    PDF ↗
  29. 2023
    DEJA VU: Continual Model Generalization For Unseen DomainsChenxi Liu, Lixu Wang, Lingjuan Lyu … Qi ZhuICLR
    PDF ↗
  30. 2023
    Artificial Neuronal Ensembles with Learned Context Dependent GatingM. Tilley, Michelle Miller, David J. FreedmanICLR
    PDF ↗
  31. 2023
  32. 2023
  33. 2023
    Online Bias Correction for Task-Free Continual LearningA. Chrysakis, Marie-Francine MoensICLR
  34. 2023
    Online Boundary-Free Continual Learning by Scheduled Data PriorHyun-woo Koh, M. Seo, Jihwan Bang … Jonghyun ChoiICLR
  35. 2023
  36. 2023
    Continual Learning of Language ModelsZixuan Ke, Yijia Shao, Haowei Lin … Bin LiuICLR
  37. 2023
  38. 2023
    Optimizing Spca-based Continual Learning: A Theoretical ApproachChunchun Yang, Malik Tiomoko, Zengfu WangICLR
  39. 2023
    Self-Supervised Continual LearningK. Thakral, S. Mittal, Utkarsh Uppal … Richa SinghICLR
  40. 2023
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.