Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

68 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2024
    Parseval Regularization for Continual Reinforcement LearningWesley Chung, Lynn Cherif, D. Meger, D. PrecupNeurIPS
    PDF ↗
  2. 2024
    Adaptive LoRA Merging for Efficient Domain Incremental LearningL. Quarantiello, E. Coleman, J. Hurtado, Vincenzo LomonacoNeurIPS
  3. 2024
    Deep Policy Gradient Methods Without Batch Updates, Target Networks, or Replay BuffersG. Vasan, Mohamed Elsayed, Alireza Azimi … A. MahmoodNeurIPS
    PDF ↗
  4. 2024
    Dealing with Synthetic Data Contamination in Online Continual LearningMaorong Wang, Nicolas Michel, Jiafeng Mao, Toshihiko YamasakiNeurIPS
    PDF ↗
  5. 2024
    An Efficient Memory Module for Graph Few-Shot Class-Incremental LearningDong Li, Aijia Zhang, Junqi Gao, Biqing QiNeurIPS
    PDF ↗
  6. 2024
    BendVLM: Test-Time Debiasing of Vision-Language EmbeddingsWalter Gerych, Haoran Zhang, K. Hamidieh … Marzyeh GhassemiNeurIPS
    PDF ↗
  7. 2024
    Non-Stationary Learning of Neural Networks with Automatic Soft Parameter ResetAlexandre Galashov, Michalis K. Titsias, Andr'as Gyorgy … M. SahaniNeurIPS
    PDF ↗
  8. 2024
    Continual Audio-Visual Sound SeparationWeiguo Pian, Yiyang Nan, Shijian Deng … Yapeng TianNeurIPS
    PDF ↗
  9. 2024PDF ↗
  10. 2024PDF ↗
  11. 2024
    PCoTTA: Continual Test-Time Adaptation for Multi-Task Point Cloud UnderstandingJincen Jiang, Qianyu Zhou, Yuhang Li … Xuequan LuNeurIPS
    PDF ↗
  12. 2024
    Incremental Learning of Retrievable Skills For Efficient Continual Task AdaptationDaehee Lee, Minjong Yoo, Woo Kyung Kim … Honguk WooNeurIPS
    PDF ↗
  13. 2024PDF ↗
  14. 2024
    Learning Successor Features the Simple WayRaymond Chua, Arna Ghosh, Christos Kaplanis … D. PrecupNeurIPS
    PDF ↗
  15. 2024
    Adapting Diffusion Models for Improved Prompt Compliance and Controllable Image SynthesisDeepak Sridhar, Abhishek Peri, Rohith Rachala, Nuno VasconcelosNeurIPS
    PDF ↗
  16. 2024
    LoRA vs Full Fine-tuning: An Illusion of EquivalenceReece Shuttleworth, Jacob Andreas, Antonio Torralba, Pratyusha SharmaNeurIPS
    PDF ↗
  17. 2024PDF ↗
  18. 2024
    Vector Quantization Prompting for Continual LearningLi Jiao, Qiuxia Lai, Yu Li, Qiang XuNeurIPS
    PDF ↗
  19. 2024
    LLMs Can Evolve Continually on Modality for X-Modal ReasoningJiazuo Yu, Haomiao Xiong, Lu Zhang … Long ChenNeurIPS
    PDF ↗
  20. 2024
    How to Continually Adapt Text-to-Image Diffusion Models for Flexible Customization?Jiahua Dong, Wen-Qi Liang, Hong-Liu Li … F. KhanNeurIPS
    PDF ↗
  21. 2024
    OVS Meets Continual Learning: Towards Sustainable Open-Vocabulary SegmentationDongjun Hwang, Minyoung Lee, S. Oh, Junsuk ChoeNeurIPS
    PDF ↗
  22. 2024PDF ↗
  23. 2024
    Temporal-Difference Variational Continual LearningL. Melo, Alessandro Abate, Yarin GalNeurIPS
    PDF ↗
  24. 2024
    Continual Learning in the Frequency DomainRuiqi Liu, Boyu Diao, Libo Huang … Yongjun XuNeurIPS
    PDF ↗
  25. 2024
    Predictive Attractor ModelsRamy Mounir, Sudeep SarkarNeurIPS
    PDF ↗
  26. 2024
    Beyond Prompts: Dynamic Conversational Benchmarking of Large Language ModelsDavid Castillo-Bolado, Joseph Davidson, F. Gray, Marek RosaNeurIPS
    PDF ↗
  27. 2024
    DOTA: Distributional Test-Time Adaptation of Vision-Language ModelsZongbo Han, Jia-Long Yang, Junfa Li … Changqing ZhangNeurIPS
    PDF ↗
  28. 2024
    Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual LearningXin-Rui Wang, Chuan-Xing Geng, Wenhai Wan … Songcan ChenNeurIPS
    PDF ↗
  29. 2024
    Task-recency bias strikes back: Adapting covariances in Exemplar-Free Class Incremental LearningSebastian Cygert, Grzegorz Rype's'c, Tomasz Trzcinski, Bartłomiej TwardowskiNeurIPS
    PDF ↗
  30. 2024
    UNIT: Unifying Image and Text Recognition in One Vision EncoderYi Zhu, Yanpeng Zhou, Chun-Wei Wang … Hang XuNeurIPS
    PDF ↗
  31. 2024
    Continual learning with the neural tangent ensembleAri S. Benjamin, Christian Pehle, Kyle DaruwallaNeurIPS
    PDF ↗
  32. 2024PDF ↗
  33. 2024
    Normalization and effective learning rates in reinforcement learningClare Lyle, Zeyu Zheng, Khimya Khetarpal … Will DabneyNeurIPS
    PDF ↗
  34. 2024
    Advancing Cross-domain Discriminability in Continual Learning of Vison-Language ModelsYicheng Xu, Yuxin Chen, Jiahao Nie … Manabu OkumuraNeurIPS
    PDF ↗
  35. 2024
    ViLCo-Bench: VIdeo Language COntinual learning BenchmarkC. D. de Melo, Shohreh Deldari, F. Salim … Hao XueNeurIPS
    PDF ↗
  36. 2024
    Data Attribution for Text-to-Image Models by Unlearning Synthesized ImagesSheng-Yu Wang, Aaron Hertzmann, Alexei A. Efros … Richard ZhangNeurIPS
    PDF ↗
  37. 2024PDF ↗
  38. 2024
    Visual Prompt Tuning in Null Space for Continual LearningYue Lu, Shizhou Zhang, De Cheng … Yanning ZhangNeurIPS
    PDF ↗
  39. 2024
    CorDA: Context-Oriented Decomposition Adaptation of Large Language ModelsYibo Yang, Xiao-Jie Li, Zhongzhu Zhou … Bernard GhanemNeurIPS
    PDF ↗
  40. 2024
    REP: Resource-Efficient Prompting for Rehearsal-Free Continual LearningSungho Jeon, Xinyue Ma, Kwang In Kim, Myeongjae JeonNeurIPS
    PDF ↗
  41. 2024PDF ↗
  42. 2024PDF ↗
  43. 2024PDF ↗
  44. 2024
    HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language ModelsBernal Jimenez Gutierrez, Yiheng Shu, Yu Gu … Yu SuNeurIPS
    PDF ↗
  45. 2024
    Mixture of Experts Meets Prompt-Based Continual LearningMinh Le, An Nguyen, Huy Nguyen … Nhat HoNeurIPS
    PDF ↗
  46. 2024PDF ↗
  47. 2024
    No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPOSkander Moalla, A. Miele, Razvan Pascanu, Caglar GulcehreNeurIPS
    PDF ↗
  48. 2024
    Make Continual Learning Stronger via C-FlatAng Bian, Wei Li, Hangjie Yuan … Tao FengNeurIPS
    PDF ↗
  49. 2024PDF ↗
  50. 2024
    GACL: Exemplar-Free Generalized Analytic Continual LearningHuiping Zhuang, Yizhu Chen, Di Fang … Cen ChenNeurIPS
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.