Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

37 papers of 8,653Sort Recent · Most cited
  1. 2024
    Self-Composing Policies for Scalable Continual Reinforcement LearningMikel Malagón, Josu Ceberio, José A. LozanoICML
    PDF ↗
  2. 2024
    Expert Routing with Synthetic Data for Continual LearningYewon Byun, Sanket Vaibhav Mehta, Saurabh Garg … Zachary C. LiptonICML
    PDF ↗
  3. 2024
    Selective Forgetting in Task-Progressive Learning Through Machine UnlearningRupesh Raj Karn, Johann Knechtel, Ozgur SinanogluICML · New York University
  4. 2024
    Clustering-Based Automatic Codeword Lengths Determination in Self-Supervised LearningTakanori Takebayashi, Naoki Masuyama, Yusuke NojimaICML · Osaka Metropolitan University · Tokyo Metropolitan University
  5. 2024
    An Effective Dynamic Gradient Calibration Method for Continual LearningWei-Chen Lin, Jiaxiang Chen, Ruomin Huang, Hu DingICML
    PDF ↗
  6. 2024
    An Attention-based Representation Distillation Baseline for Multi-Label Continual LearningMartin Menabue, Emanuele Frascaroli, M. Boschini … Simone CalderaraICML
    PDF ↗
  7. 2024PDF ↗
  8. 2024
    A Statistical Theory of Regularization-Based Continual LearningXuyang Zhao, Hui–Yuan Wang, Weiran Huang, Wei LinICML
    PDF ↗
  9. 2024PDF ↗
  10. 2024
    Conditional Language Learning with ContextXiao Zhang, Miao Li, Ji WuICML
    PDF ↗
  11. 2024
    Provable Contrastive Continual LearningYichen Wen, Zhiquan Tan, Kaipeng Zheng … Weiran HuangICML
    PDF ↗
  12. 2024
    Learning to Continually Learn with the Bayesian PrincipleSoochan Lee, Hyeonseong Jeon, Jaehyeon Son, Gunhee KimICML
    PDF ↗
  13. 2024
    Compositional Few-Shot Class-Incremental LearningYixiong Zou, Shanghang Zhang, Haichen Zhou … Ruixuan LiICML
    PDF ↗
  14. 2024PDF ↗
  15. 2024
    Kullback-Leibler Reservoir Sampling for Fairness in Continual LearningSotirios Nikoloutsopoulos, Iordanis Koutsopoulos, Michalis K. TitsiasICML · Athens University of Economics and Business
  16. 2024
    Position: Lifetime tuning is incompatible with continual reinforcement learningGolnaz Mesbahi, Parham Mohammad Panahi, Olya Mastikhina … Adam WhiteICML
    PDF ↗
  17. 2024PDF ↗
  18. 2024PDF ↗
  19. 2024
    Layerwise Proximal Replay: A Proximal Point Method for Online Continual LearningJason J. Yoo, Yunpeng Liu, Frank Wood, Geoff PleissICML
    PDF ↗
  20. 2024PDF ↗
  21. 2024PDF ↗
  22. 2024
    Continual Few-Shot Relation Learning Via Dynamic Margin Loss and Space RecallYongbing Li, Pengfei Duan, Yi Rong … Aoxing WangICML · Wuhan University of Technology
    PDF ↗
  23. 2024
    Neighboring Perturbations of Knowledge Editing on Large Language ModelsJun-Yu Ma, Zhen-Hua Ling, Ningyu Zhang, Jia-Chen GuICML
    PDF ↗
  24. 2024
    Multi-layer Rehearsal Feature Augmentation for Class-Incremental LearningBowen Zheng, Da-Wei Zhou, Han-Jia Ye, De-Chuan ZhanICML
  25. 2024
    Federated Continual Learning via Prompt-based Dual Knowledge TransferHongming Piao, Yichen Wu, Dapeng Wu, Ying WeiICML
  26. 2024
  27. 2024
  28. 2024
  29. 2024
    Rapid Learning without Catastrophic Forgetting in the Morris Water MazeRaymond Wang, Jaedong Hwang, Akhilan Boopathy, I. FieteICML
  30. 2024
  31. 2024
    Learning in Deep Factor Graphs with Gaussian Belief PropagationSeth Nabarro, Mark van der Wilk, Andrew J. DavisonICML
    PDF ↗
  32. 2024
    One Size Fits All for Semantic Shifts: Adaptive Prompt Tuning for Continual LearningDoyoung Kim, Susik Yoon, Dongmin Park … Jae-Gil LeeICML
    PDF ↗
  33. 2024
    STELLA: Continual Audio-Video Pre-training with Spatio-Temporal Localized AlignmentJaewoo Lee, Jaehong Yoon, Wonjae Kim … Sung Ju HwangICML
    PDF ↗
  34. 2024PDF ↗
  35. 2024
    Rethinking Momentum Knowledge Distillation in Online Continual LearningNicolas Michel, Maorong Wang, Ling Xiao, Toshihiko YamasakiICML
    PDF ↗
  36. 2024
    Lookbehind-SAM: k steps back, 1 step forwardGonçalo Mordido, Pranshu Malviya, Aristide Baratin, Sarath ChandarICML
    PDF ↗
  37. 2024PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.