Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

37 papers of 11,817Sort Recent · Most cited
  1. 2023
    Continual Learning via Sequential Function-Space Variational InferenceTim G. J. Rudner, Freddie Bickford-Smith, Qixuan Feng … Y. GalICML
    PDF ↗
  2. 2023
    Learning in Deep Factor Graphs with Gaussian Belief PropagationSeth Nabarro, Mark van der Wilk, Andrew J. DavisonICML
    PDF ↗
  3. 2023
    One Size Fits All for Semantic Shifts: Adaptive Prompt Tuning for Continual LearningDoyoung Kim, Susik Yoon, Dongmin Park … Jae-Gil LeeICML
    PDF ↗
  4. 2023
    STELLA: Continual Audio-Video Pre-training with Spatio-Temporal Localized AlignmentJaewoo Lee, Jaehong Yoon, Wonjae Kim … Sung Ju HwangICML
    PDF ↗
  5. 2023PDF ↗
  6. 2023
    Rethinking Momentum Knowledge Distillation in Online Continual LearningNicolas Michel, Maorong Wang, L. Xiao, T. YamasakiICML
    PDF ↗
  7. 2023
    Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio DetectionXiaohui Zhang, Jiangyan Yi, J. Tao … Chu-Yuan ZhangICML
    PDF ↗
  8. 2023
    Lookbehind-SAM: k steps back, 1 step forwardGonçalo Mordido, Pranshu Malviya, A. Baratin, Sarath ChandarICML
    PDF ↗
  9. 2023
    Learning Expressive Priors for Generalization and Uncertainty Estimation in Neural NetworksDominik Schnaus, Jongseok Lee, D. Cremers, Rudolph TriebelICML
    PDF ↗
  10. 2023
    Parameter-Level Soft-Masking for Continual LearningTatsuya Konishi, M. Kurokawa, C. Ono … Bin LiuICML
    PDF ↗
  11. 2023PDF ↗
  12. 2023
    Learnability and Algorithm for Continual LearningGyuhak Kim, Changnan Xiao, Tatsuya Konishi, Bin LiuICML
    PDF ↗
  13. 2023
    Continual Learners are Incremental Model GeneralizersJaehong Yoon, Sung Ju Hwang, Yu CaoICML
    PDF ↗
  14. 2023PDF ↗
  15. 2023
    Fair yet Asymptotically Equal Collaborative LearningXiaoqiang Lin, Xinyi Xu, S. Ng … B. LowICML
    PDF ↗
  16. 2023
    Continual Learning in Linear Classification on Separable DataItay Evron, E. Moroshko, G. Buzaglo … Daniel SoudryICML
    PDF ↗
  17. 2023
    Memory-Based Dual Gaussian Processes for Sequential LearningPaul E. Chang, Prakhar Verma, S. T. John … M. E. KhanICML
    PDF ↗
  18. 2023
    Continual Task Allocation in Meta-Policy Network via Sparse PromptingYijun Yang, Tianyi Zhou, Jing Jiang … Yuhui ShiICML
    PDF ↗
  19. 2023
    Lifelong Language Pretraining with Distribution-Specialized ExpertsWuyang Chen, Yanqi Zhou, Nan Du … Claire CuICML
    PDF ↗
  20. 2023PDF ↗
  21. 2023
    BiRT: Bio-inspired Replay in Vision Transformers for Continual LearningKishaan Jeeveswaran, Prashant Bhat, Bahram Zonooz, E. AraniICML
    PDF ↗
  22. 2023
    DualHSIC: HSIC-Bottleneck and Alignment for Continual LearningZifeng Wang, Zheng Zhan, Yifan Gong … Jennifer G. DyICML
    PDF ↗
  23. 2023
    The Ideal Continual Learner: An Agent That Never ForgetsLiangzu Peng, Paris V. Giampouras, René VidalICML
    PDF ↗
  24. 2023
    Does Continual Learning Equally Forget All Parameters?Haiyan Zhao, Tianyi Zhou, Guodong Long … Chengqi ZhangICML
    PDF ↗
  25. 2023
    Prototype-Sample Relation Distillation: Towards Replay-Free Continual LearningNader Asadi, Mohammad Davar, S. Mudur … Eugene BelilovskyICML
    PDF ↗
  26. 2023
    Understanding plasticity in neural networksClare Lyle, Zeyu Zheng, Evgenii Nikishin … Will DabneyICML
    PDF ↗
  27. 2023
    Task-Specific Skill Localization in Fine-tuned Language ModelsAbhishek Panigrahi, Nikunj Saunshi, Haoyu Zhao, Sanjeev AroraICML
    PDF ↗
  28. 2023
    Theory on Forgetting and Generalization of Continual LearningSen Lin, Pei-Zhong Ju, Yitao Liang, N. ShroffICML
    PDF ↗
  29. 2023
    Exploring the Benefits of Training Expert Language Models over Instruction TuningJoel Jang, Seungone Kim, Seonghyeon Ye … Minjoon SeoICML
    PDF ↗
  30. 2023
    Efficient Parametric Approximations of Neural Network Function Space DistanceNikita Dhawan, Sicong Huang, Juhan Bae, R. GrosseICML
    PDF ↗
  31. 2023
    Neuro Symbolic Continual Learning: Knowledge, Reasoning Shortcuts and Concept RehearsalE. Marconato, G. Bontempo, E. Ficarra … Stefano TesoICML
    PDF ↗
  32. 2023PDF ↗
  33. 2023PDF ↗
  34. 2023
    Probabilistic Bilevel Coreset SelectionXiao Zhou, Renjie Pi, Weizhong Zhang … T. ZhangICML
    PDF ↗
  35. 2023
  36. 2023
    Optimizing Mode Connectivity for Class Incremental LearningHaitao Wen, Haoyang Cheng, Heqian Qiu … Hongliang LiICML
  37. 2023
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.