Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

160 papers of 11,817 · showing 51–100Sort Recent · Most cited
  1. 2025PDF ↗
  2. 2025
    Enhancing Multimodal Continual Instruction Tuning with BranchLoRADu-Zhen Zhang, Yong Ren, Zhongzhi Li … Jinfeng BaiACL
    PDF ↗
  3. 2025PDF ↗
  4. 2025PDF ↗
  5. 2025
    Model Editing with Graph-Based External MemoryY. Atri, Ahmed M. Alaa, Thomas HartvigsenACL
    PDF ↗
  6. 2025PDF ↗
  7. 2025PDF ↗
  8. 2025
    FairSteer: Inference Time Debiasing for LLMs with Dynamic Activation SteeringYichen Li, Zhiting Fan, Ruizhe Chen … Zuozhu LiuACL
    PDF ↗
  9. 2025
    SEE: Continual Fine-tuning with Sequential Ensemble of ExpertsZhi-Lin Wang, Yafu Li, Xiaoye Qu, Yu ChengACL
    PDF ↗
  10. 2025
    TiC-LM: A Web-Scale Benchmark for Time-Continual LLM PretrainingJeffrey Li, Mohammadreza Armandpour, Iman Mirzadeh … Fartash FaghriACL
    PDF ↗
  11. 2025PDF ↗
  12. 2025PDF ↗
  13. 2025
    SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMsYige Xu, Xu Guo, Zhiwei Zeng, Chunyan MiaoACL
    PDF ↗
  14. 2025PDF ↗
  15. 2025
  16. 2025
  17. 2025
  18. 2025
  19. 2025
  20. 2025
  21. 2024
    Unveiling and Addressing Pseudo Forgetting in Large Language ModelsHuashan Sun, Yizhe Yang, Yinghao Li … Yang GaoACL
    PDF ↗
  22. 2024
    Exploring Forgetting in Large Language Model Pre-TrainingChonghua Liao, Ruobing Xie, Xingwu Sun … Zhanhui KangACL
    PDF ↗
  23. 2024PDF ↗
  24. 2024PDF ↗
  25. 2024
    QAEncoder: Towards Aligned Representation Learning in Question Answering SystemZheng-Ren Wang, Qinhan Yu, Shida Wei … Wentao ZhangACL
    PDF ↗
  26. 2024PDF ↗
  27. 2024
    Continual Dialogue State Tracking via Reason-of-Select DistillationYujie Feng, Bo Liu, Xiaoyu Dong … A. LamACL
    PDF ↗
  28. 2024
    MoExtend: Tuning New Experts for Modality and Task ExtensionShan Zhong, Shanghua Gao, Zhongzhan Huang … Pan ZhouACL
    PDF ↗
  29. 2024PDF ↗
  30. 2024PDF ↗
  31. 2024PDF ↗
  32. 2024
    DAFNet: Dynamic Auxiliary Fusion for Sequential Model Editing in Large Language ModelsTaolin Zhang, Qizhou Chen, Dongyang Li … Junyuan HuangACL
    PDF ↗
  33. 2024PDF ↗
  34. 2024
    HFT: Half Fine-Tuning for Large Language ModelsTingfeng Hui, Zhenyu Zhang, Shuohuan Wang … Hua WuACL
    PDF ↗
  35. 2024
    Don't Half-listen: Capturing Key-part Information in Continual Instruction TuningYongquan He, Xuancheng Huang, Minghao Tang … Yifu GaoACL
    PDF ↗
  36. 2024PDF ↗
  37. 2024PDF ↗
  38. 2024
    Unveiling Linguistic Regions in Large Language ModelsZhihao Zhang, Jun Zhao, Qi Zhang … Xuanjing HuangACL
    PDF ↗
  39. 2024PDF ↗
  40. 2024
    Self-Distillation Bridges Distribution Gap in Language Model Fine-TuningZhaorui Yang, Qian Liu, Tianyu Pang … Wei ChenACL
    PDF ↗
  41. 2024
    Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction TuningZhiyang Xu, Chao Feng, Rulin Shao … Lifu HuangACL
    PDF ↗
  42. 2024
    Incremental Sequence Labeling: A Tale of Two ShiftsShengjie Qiu, Junhao Zheng, Zhen Liu … Qianli MaACL
    PDF ↗
  43. 2024PDF ↗
  44. 2024PDF ↗
  45. 2024PDF ↗
  46. 2024
    LLaMA Pro: Progressive LLaMA with Block ExpansionChengyue Wu, Yukang Gan, Yixiao Ge … Ying ShanACL
    PDF ↗
  47. 2024
  48. 2024
  49. 2024
  50. 2024
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.