Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

1,193 papers of 6,984 · showing 851–900Sort Recent · Most cited
  1. 2024
    DiffClass: Diffusion-Based Class Incremental LearningZichong Meng, Zhang Jie, Changdi Yang … Yanzhi WAngECCV
    PDF ↗
  2. 2024PDF ↗
  3. 2024
    Mixture-of-LoRAs: An Efficient Multitask Tuning Method for Large Language ModelsWenfeng Feng, Chuzhan Hao, Yuewei Zhang … Hao WangInternational Conference on Language Resources and Evalua…
    PDF ↗
  4. 2024
    GUIDE: Guidance-based Incremental Learning with Diffusion ModelsBartosz Cywiński, Kamil Rafał Deja, T. P. Trzcinski … Łukasz KucińskiEuropean Conference on Artificial Intelligence
    PDF ↗
  5. 2024PDF ↗
  6. 2024
    DP-CRE: Continual Relation Extraction via Decoupled Contrastive Learning and Memory Structure PreservationHuang, Mengyi, Meng Xiao, Ludi Wang, Yi DuInternational Conference on Language Resources and Evalua…
    PDF ↗
  7. 2024PDF ↗
  8. 2024
    Open-world Machine Learning: A Review and New OutlooksFei Zhu, Shijie Ma, Zhen Cheng … Liu, Cheng-LinarXiv
    PDF ↗
  9. 2024
    Zero-shot Generalizable Incremental Learning for Vision-Language Object DetectionJieren Deng, Haojian Zhang, Kun Ding … Yunkuan WangNeurIPS
    PDF ↗
  10. 2024
    Transformers for Supervised Online Continual LearningJörg Bornschein, Yazhe Li, Amal Rannen-TrikiarXiv
    PDF ↗
  11. 2024PDF ↗
  12. 2024PDF ↗
  13. 2024
    Disentangling the Causes of Plasticity Loss in Neural NetworksClare Lyle, Zeyu Zheng, Khimya Khetarpal … Will DabneyCoLLAs
    PDF ↗
  14. 2024PDF ↗
  15. 2024PDF ↗
  16. 2024
    A Comprehensive Survey of Continual Learning: Theory, Method and ApplicationLiyuan Wang, Xingxing Zhang, Hang Su, Jun ZhuTPAMI · Tsinghua University
    PDF ↗
  17. 2024PDF ↗
  18. 2024
    Photonic neuromorphic architecture for tens-of-task lifelong learningYuan Cheng, Jianing Zhang, Tiankuang Zhou … Lu FangLight: Science & Applications
  19. 2024
    ConSept: Continual Semantic Segmentation via Adapter-based Vision TransformerBowen Dong, Guanglei Yang, Wangmeng Zuo, Lei ZhangarXiv
    PDF ↗
  20. 2024
    One-stage Prompt-based Continual LearningYoungeun Kim, Yuhang Li, Priyadarshini PandaECCV
    PDF ↗
  21. 2024
    Making Pre-trained Language Models Better Continual Few-Shot Relation ExtractorsShengkun Ma, Jiale Han, Yi Liang, Bo ChengInternational Conference on Language Resources and Evalua…
    PDF ↗
  22. 2024PDF ↗
  23. 2024
    MemoryPrompt: A Light Wrapper to Improve Context Tracking in Pre-trained Language ModelsNathanaël Carraz Rakotonirina, Marco BaroniInternational Conference on Language Resources and Evalua…
    PDF ↗
  24. 2024
    Leveraging dendritic properties to advance machine learning and neuro-inspired computing.Michalis Pagkalos, Roman Makarov, Panayiota PoiraziCurrent Opinion in Neurobiology · University of Crete · Institute of Molecular Biology and Biotechnology · +2
    PDF ↗
  25. 2024
    Unveiling Linguistic Regions in Large Language ModelsZhihao Zhang, Jun Zhao, Qi Zhang … Xuanjing HuangACL
    PDF ↗
  26. 2024
    Self-Distillation Bridges Distribution Gap in Language Model Fine-TuningZhaorui Yang, Tianyu Pang, Haozhe Feng … Qian LiuACL
    PDF ↗
  27. 2024
    Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing AgentXiaoyan Yu, Tongxu Luo, Yifan Wei … Liehuang ZhuEMNLP
    PDF ↗
  28. 2024
    Can Similarity-Based Domain-Ordering Reduce Catastrophic Forgetting for Intent Recognition?Amogh Mannekote, Xiaoyi Tian, Kristy Elizabeth Boyer, Bonnie J. DorrarXiv
    PDF ↗
  29. 2024
    Dynamic Environment Responsive Online Meta-Learning with Fairness AwarenessChen Zhao, Feng Mi, Xintao Wu … Feng ChenACM Transactions · Baylor University · The University of Texas at Dallas · +1
    PDF ↗
  30. 2024
    Online continual learning through unsupervised mutual information maximizationHeinke Hihn, Daniel A. BraunNeurocomputing · Universität Ulm
  31. 2024
    From Data to Optimization: Data-Free Deep Incremental Hashing With Data Disambiguation and Adaptive ProxiesQinghang Su, Dayan Wu, Chenming Wu … Weiping WangIEEE TCSVT · Chinese Academy of Sciences · Institute of Information Engineering · +2
  32. 2024
    Structural Knowledge Informed Continual Multivariate Time Series ForecastingZijie Pan, Yushan Jiang, Dongjin Song … Yuriy NevmyvakaarXiv
    PDF ↗
  33. 2024PDF ↗
  34. 2024
    Class-incremental Learning for Time Series: Benchmark and EvaluationZhongzheng Qiao, Quang Pham, Zhengwei Cao … Savitha RamasamyKDD
    PDF ↗
  35. 2024
    Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural NetworksMingqing Xiao, Qingyan Meng, Zongpeng Zhang … Zhouchen LinICLR
    PDF ↗
  36. 2024
    Neuro-mimetic Task-free Unsupervised Online Learning with Continual Self-Organizing MapsHitesh Vaidya, Travis Desell, Ankur Mali, Alexander G. OrorbiaarXiv
    PDF ↗
  37. 2024PDF ↗
  38. 2024PDF ↗
  39. 2024
    MoRAL: MoE Augmented LoRA for LLMs' Lifelong LearningShu Yang, Muhammad Asif Ali, Chenglong Wang … Di WangarXiv
    PDF ↗
  40. 2024
    Maintaining Adversarial Robustness in Continuous LearningXiaolei Ru, Xiaowei Cao, Zijia Liu … Gang YanarXiv
    PDF ↗
  41. 2024
    Incremental Sequence Labeling: A Tale of Two ShiftsShengjie Qiu, Junhao Zheng, Zhen Liu … Qianli MaACL
    PDF ↗
  42. 2024
    Evaluating and Improving Continual Learning in Spoken Language UnderstandingMuqiao Yang, Xiang Li, Umberto Cappellazzo … Bhiksha RajarXiv
    PDF ↗
  43. 2024PDF ↗
  44. 2024
    Is Continual Learning Ready for Real-world Challenges?Theodora Kontogianni, Yuanwen Yue, Siyu Tang, Konrad SchindlerarXiv
    PDF ↗
  45. 2024
    PNSP: Overcoming catastrophic forgetting using Primary Null Space Projection in continual learningDaiLiang Zhou, Yonghong SongPattern Recognition Letters · Xi'an Jiaotong University
  46. 2024
    Balancing the Causal Effects in Class-Incremental LearningJunhao Zheng, Ruiyan Wang, Chongzhi Zhang … Qianli MaarXiv
    PDF ↗
  47. 2024
    Layerwise Proximal Replay: A Proximal Point Method for Online Continual LearningJason J. Yoo, Yunpeng Liu, Frank Wood, Geoff PleissICML
    PDF ↗
  48. 2024PDF ↗
  49. 2024
    Can LLMs Learn New Concepts Incrementally without Forgetting?Junhao Zheng, Shengjie Qiu, Qianli MaarXiv
    PDF ↗
  50. 2024
    A novel spatial-frequency domain network for zero-shot incremental learningJie Ren, Yang Zhao, Weichuan Zhang, Changming SunarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.