Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

48 papers of 8,653Sort Recent · Most cited
  1. 2024
    Efficient Online Reinforcement Learning Fine-Tuning Need Not Retain Offline DataZhiyuan Zhou, Peng, Andy, Qiyang Li … Aviral KumarICLR
    PDF ↗
  2. 2024PDF ↗
  3. 2024PDF ↗
  4. 2024
    Plastic Learning with Deep Fourier FeaturesAlex Lewandowski, Dale Schuurmans, Marlos C. MachadoICLR
    PDF ↗
  5. 2024PDF ↗
  6. 2024
    Closed-form merging of parameter-efficient modules for Federated Continual LearningRiccardo Salami, Pietro Buzzega, Matteo Mosconi … Simone CalderaraICLR
    PDF ↗
  7. 2024
    LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model MergingKe Wang, Nikolaos Dimitriadis, Alessandro Favero … Pascal FrossardICLR
    PDF ↗
  8. 2024PDF ↗
  9. 2024PDF ↗
  10. 2024
    Adapt-∞: Scalable Continual Multimodal Instruction Tuning via Dynamic Data SelectionAdyasha Maharana, Jaehong Yoon, Tianlong Chen, Mohit BansalICLR
    PDF ↗
  11. 2024
    Neuroplastic Expansion in Deep Reinforcement LearningJiashun Liu, Johan Obando-Ceron, Aaron Courville, Ling PanICLR
    PDF ↗
  12. 2024
    LeanAgent: Lifelong Learning for Formal Theorem ProvingAdarsh Kumarappan, Mohit Tiwari, Peiyang Song … Anima AnandkumarICLR
    PDF ↗
  13. 2024PDF ↗
  14. 2024
    Self-Updatable Large Language Models by Integrating Context into Model ParametersYu Wang, Xinshuang Liu, Xiusi Chen … Julian McAuleyICLR
    PDF ↗
  15. 2024
    LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual LearningLiangzu Peng, Juan Elenter, Joshua Agterberg … René Víctor Valqui VidalICLR
    PDF ↗
  16. 2024PDF ↗
  17. 2024
    Theory on Mixture-of-Experts in Continual LearningHongbo Li, Sen Lin, Lingjie Duan … Ness B. ShroffICLR
    PDF ↗
  18. 2024
    MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object DetectionZhuoxiao Chen, Junjie Meng, Mahsa Baktashmotlagh … Yadan LuoICLR
    PDF ↗
  19. 2024
    Towards Continuous Reuse of Graph Models via Holistic Memory DiversificationZiyue Qiao, Junren Xiao, Qingqiang Sun … Xiong, HuiICLR
    PDF ↗
  20. 2024
    Learning Continually by Spectral RegularizationAlex Lewandowski, Bortkiewicz, Michał, Saurabh Kumar … Marlos C. MachadoICLR
    PDF ↗
  21. 2024PDF ↗
  22. 2024
    Perturbation-Restrained Sequential Model EditingJun-Yu Ma, Hong Wang, Hao-Xiang Xu … Jia-Chen GuICLR
    PDF ↗
  23. 2024
    A Second-Order Perspective on Model Compositionality and Incremental LearningAngelo Porrello, Lorenzo Bonicelli, Pietro Buzzega … Rita CucchiaraICLR
    PDF ↗
  24. 2024PDF ↗
  25. 2024PDF ↗
  26. 2024
    Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained ComputationWenxuan Zhang, Youssef Mohamed, Bernard Ghanem … Mohamed ElhoseinyICLR
    PDF ↗
  27. 2024
    Scalable Language Model with Generalized Continual LearningBohao Peng, Zhuotao Tian, Shu Liu … Jiaya JiaICLR
    PDF ↗
  28. 2024PDF ↗
  29. 2024PDF ↗
  30. 2024
    A Unified and General Framework for Continual LearningZhenyi Wang, Yan Li, Li Shen, Heng HuangICLR
    PDF ↗
  31. 2024
    Function-space Parameterization of Neural Networks for Sequential LearningAidan Scannell, Riccardo Mereu, Paul E. Chang … Arno SolinICLR
    PDF ↗
  32. 2024PDF ↗
  33. 2024
    Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural NetworksMingqing Xiao, Qingyan Meng, Zongpeng Zhang … Zhouchen LinICLR
    PDF ↗
  34. 2024
    Elastic Feature Consolidation for Cold Start Exemplar-free Incremental LearningSimone Magistri, Tomaso Trinci, Albin Soutif--Cormerais … Andrew D. BagdanovICLR
    PDF ↗
  35. 2024PDF ↗
  36. 2024PDF ↗
  37. 2024
    Locality Sensitive Sparse Encoding for Learning World Models OnlineZichen Liu, Chao Du, Wee Sun Lee, Min LinICLR
    PDF ↗
  38. 2024
    Divide and not forget: Ensemble of selectively trained experts in Continual LearningGrzegorz Rypeść, Sebastian Cygert, Valeriya Khan … Bartłomiej TwardowskiICLR · Warsaw University of Technology · Integrated Detector Electronics AS (Norway) · +6
    PDF ↗
  39. 2024
    Prompt Gradient Projection for Continual LearningJingyang Qiao, Zhizhong Zhang, Xin Tan … Yuan XieICLR
  40. 2024
  41. 2024
  42. 2024
  43. 2024
  44. 2024
  45. 2024
  46. 2024
  47. 2024
  48. 2024
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.