Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

34 papers of 8,653Sort Recent · Most cited
  1. 2024
    Selective Forgetting in Task-Progressive Learning Through Machine UnlearningRupesh Raj Karn, Johann Knechtel, Ozgur SinanogluICML · New York University
  2. 2024
    Clustering-Based Automatic Codeword Lengths Determination in Self-Supervised LearningTakanori Takebayashi, Naoki Masuyama, Yusuke NojimaICML · Osaka Metropolitan University · Tokyo Metropolitan University
  3. 2024
    Adjusting Model Size in Continual Gaussian Processes: How Big is Big Enough?Guiomar Pescador-Barrios, Sarah Filippi, Mark van der WilkICML
    PDF ↗
  4. 2024
    An Effective Dynamic Gradient Calibration Method for Continual LearningWei-Chen Lin, Jiaxiang Chen, Ruomin Huang, Hu DingICML
    PDF ↗
  5. 2024
    An Attention-based Representation Distillation Baseline for Multi-Label Continual LearningMartin Menabue, Emanuele Frascaroli, M. Boschini … Simone CalderaraICML
    PDF ↗
  6. 2024PDF ↗
  7. 2024PDF ↗
  8. 2024
    A Statistical Theory of Regularization-Based Continual LearningXuyang Zhao, Hui–Yuan Wang, Weiran Huang, Wei LinICML
    PDF ↗
  9. 2024PDF ↗
  10. 2024
    Conditional Language Learning with ContextXiao Zhang, Miao Li, Ji WuICML
    PDF ↗
  11. 2024
    Provable Contrastive Continual LearningYichen Wen, Zhiquan Tan, Kaipeng Zheng … Weiran HuangICML
    PDF ↗
  12. 2024
    Learning to Continually Learn with the Bayesian PrincipleSoochan Lee, Hyeonseong Jeon, Jaehyeon Son, Gunhee KimICML
    PDF ↗
  13. 2024
    Compositional Few-Shot Class-Incremental LearningYixiong Zou, Shanghang Zhang, Haichen Zhou … Ruixuan LiICML
    PDF ↗
  14. 2024PDF ↗
  15. 2024
    Kullback-Leibler Reservoir Sampling for Fairness in Continual LearningSotirios Nikoloutsopoulos, Iordanis Koutsopoulos, Michalis K. TitsiasICML · Athens University of Economics and Business
  16. 2024
    Position: Lifetime tuning is incompatible with continual reinforcement learningGolnaz Mesbahi, Parham Mohammad Panahi, Olya Mastikhina … Adam WhiteICML
    PDF ↗
  17. 2024
    Improving Continual Learning Performance and Efficiency with Auxiliary ClassifiersFilip Szatkowski, Zheng, Yaoyue, Fei Yang … Joost van de WeijerICML
    PDF ↗
  18. 2024PDF ↗
  19. 2024
    Towards Robust Graph Incremental Learning on Evolving GraphsJunwei Su, Difan Zou, Zijun Zhang, Chuan WuICML
    PDF ↗
  20. 2024PDF ↗
  21. 2024
    Layerwise Proximal Replay: A Proximal Point Method for Online Continual LearningJason J. Yoo, Yunpeng Liu, Frank Wood, Geoff PleissICML
    PDF ↗
  22. 2024
    Where is the Truth? The Risk of Getting Confounded in a Continual WorldFlorian Peter Busch, Roshni Kamath, Rupert Mitchell … Martin MundtICML
    PDF ↗
  23. 2024PDF ↗
  24. 2024PDF ↗
  25. 2024
    Continual Few-Shot Relation Learning Via Dynamic Margin Loss and Space RecallYongbing Li, Pengfei Duan, Yi Rong … Aoxing WangICML · Wuhan University of Technology
    PDF ↗
  26. 2024
    Neighboring Perturbations of Knowledge Editing on Large Language ModelsJun-Yu Ma, Zhen-Hua Ling, Ningyu Zhang, Jia-Chen GuICML
    PDF ↗
  27. 2024
    Multi-layer Rehearsal Feature Augmentation for Class-Incremental LearningBowen Zheng, Da-Wei Zhou, Han-Jia Ye, De-Chuan ZhanICML
  28. 2024
    Federated Continual Learning via Prompt-based Dual Knowledge TransferHongming Piao, Yichen Wu, Dapeng Wu, Ying WeiICML
  29. 2024
  30. 2024
  31. 2024
  32. 2024
    Rapid Learning without Catastrophic Forgetting in the Morris Water MazeRaymond Wang, Jaedong Hwang, Akhilan Boopathy, I. FieteICML
  33. 2024
  34. 2024PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.