Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

57 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2024
    Efficient Online Reinforcement Learning Fine-Tuning Need Not Retain Offline DataZhi-Yuan Zhou, Andy Peng, Qiyang Li … Aviral KumarICLR
    PDF ↗
  2. 2024PDF ↗
  3. 2024PDF ↗
  4. 2024
    Plastic Learning with Deep Fourier FeaturesAlex Lewandowski, Dale Schuurmans, Marlos C. MachadoICLR
    PDF ↗
  5. 2024PDF ↗
  6. 2024
    Closed-form merging of parameter-efficient modules for Federated Continual LearningRiccardo Salami, Pietro Buzzega, Matteo Mosconi … Simone CalderaraICLR
    PDF ↗
  7. 2024
    LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model MergingKe Wang, Nikolaos Dimitriadis, Alessandro Favero … Pascal FrossardICLR
    PDF ↗
  8. 2024PDF ↗
  9. 2024PDF ↗
  10. 2024
    Adapt-∞: Scalable Continual Multimodal Instruction Tuning via Dynamic Data SelectionAdyasha Maharana, Jaehong Yoon, Tian-Xiang Chen, Mohit BansalICLR
    PDF ↗
  11. 2024
    Neuroplastic Expansion in Deep Reinforcement LearningJiashun Liu, Johan Obando-Ceron, A. Courville, Ling PanICLR
    PDF ↗
  12. 2024
    LeanAgent: Lifelong Learning for Formal Theorem ProvingAdarsh Kumarappan, Mo Tiwari, Peiyang Song … Anima AnandkumarICLR
    PDF ↗
  13. 2024
    On the Modeling Capabilities of Large Language Models for Sequential Decision MakingMartin Klissarov, Devon Hjelm, Alexander Toshev, Bogdan MazoureICLR
    PDF ↗
  14. 2024PDF ↗
  15. 2024
    Structural-Entropy-Based Sample Selection for Efficient and Effective LearningTianchi Xie, Jiang-Ning Zhu, Guozu Ma … Shi-Xia LiuICLR
    PDF ↗
  16. 2024
    Self-Updatable Large Language Models by Integrating Context into Model ParametersYu Wang, Xinshuang Liu, Xiusi Chen … Julian J. McAuleyICLR
    PDF ↗
  17. 2024PDF ↗
  18. 2024PDF ↗
  19. 2024
    Optimal protocols for continual learning via statistical physics and control theoryFrancesco Mori, Stefano Sarao Mannelli, Francesca MignaccoICLR
    PDF ↗
  20. 2024
    From Lazy to Rich: Exact Learning Dynamics in Deep Linear NetworksC. Dominé, Nicolas Anguita, Alexandra M. Proca … Andrew M. SaxeICLR
    PDF ↗
  21. 2024
    Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMsSungmin Cha, Sungjun Cho, Dasol Hwang, Moontae LeeICLR
    PDF ↗
  22. 2024PDF ↗
  23. 2024
    Theory on Mixture-of-Experts in Continual LearningHongbo Li, Sen-Fon Lin, Lingjie Duan … N. ShroffICLR
    PDF ↗
  24. 2024
    Behaviour DistillationAndrei Lupu, Chris Lu, Jarek Liesen … J. FoersterICLR
    PDF ↗
  25. 2024
    MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object DetectionZhuoxiao Chen, Jun-Jie Meng, Mahsa Baktashmotlagh … Yadan LuoICLR
    PDF ↗
  26. 2024
    Towards Continuous Reuse of Graph Models via Holistic Memory DiversificationZiyue Qiao, Junren Xiao, Qingqiang Sun … Hui XiongICLR
    PDF ↗
  27. 2024
    Learning Continually by Spectral RegularizationAlex Lewandowski, Saurabh Kumar, Dale Schuurmans … Marlos C. MachadoICLR
    PDF ↗
  28. 2024PDF ↗
  29. 2024
    Perturbation-Restrained Sequential Model EditingJunjie Ma, Hong Wang, Haoyang Xu … Jia-Chen GuICLR
    PDF ↗
  30. 2024
    A Second-Order Perspective on Model Compositionality and Incremental LearningA. Porrello, Lorenzo Bonicelli, Pietro Buzzega … R. CucchiaraICLR
    PDF ↗
  31. 2024PDF ↗
  32. 2024PDF ↗
  33. 2024
    Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained ComputationWenxuan Zhang, Youssef Mohamed, Bernard Ghanem … Mohamed ElhoseinyICLR
    PDF ↗
  34. 2024
    Scalable Language Model with Generalized Continual LearningBohao Peng, Zhuotao Tian, Shu Liu … Jiaya JiaICLR
    PDF ↗
  35. 2024PDF ↗
  36. 2024PDF ↗
  37. 2024PDF ↗
  38. 2024
    A Unified and General Framework for Continual LearningZhenyi Wang, Yan Li, Li Shen, Heng HuangICLR
    PDF ↗
  39. 2024
    Function-space Parameterization of Neural Networks for Sequential LearningAidan Scannell, Riccardo Mereu, Paul E. Chang … Arno SolinICLR
    PDF ↗
  40. 2024PDF ↗
  41. 2024
    Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural NetworksMingqing Xiao, Qingyan Meng, Zong-Peng Zhang … Zhouchen LinICLR
    PDF ↗
  42. 2024
    Elastic Feature Consolidation for Cold Start Exemplar-free Incremental LearningSimone Magistri, Tomaso Trinci, Albin Soutif-Cormerais … Andrew D. BagdanovICLR
    PDF ↗
  43. 2024PDF ↗
  44. 2024PDF ↗
  45. 2024PDF ↗
  46. 2024
    Divide and not forget: Ensemble of selectively trained experts in Continual LearningGrzegorz Rype's'c, Sebastian Cygert, Valeriya Khan … Bartłomiej TwardowskiICLR
    PDF ↗
  47. 2024
    Prompt Gradient Projection for Continual LearningJingyang Qiao, Zhizhong Zhang, Xin Tan … Yuan XieICLR
  48. 2024
  49. 2024
  50. 2024
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.