Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

30 papers of 8,653Sort Recent · Most cited
  1. 2024
    Recent Advances of Multimodal Continual Learning: A Comprehensive SurveyDianzhi Yu, Xinni Zhang, Yankai Chen … Irwin KingTNNLS · Chinese University of Hong Kong · Tsinghua University · +1
    PDF ↗
  2. 2026
    Continual Out-of-Distribution Detection with Analytic Neural CollapseSaleh Momeni, Changnan Xiao, Bing Jie Darius LiuAAAI · University of Illinois Chicago
  3. 2025
    Learning After Model DeploymentDerda Kaymak, Gyuhak Kim, Tomoya Kaichi … Bing LiuFrontiers · University of Illinois Chicago · Accenture (United States) · +1
    PDF ↗
  4. 2025
    SPARC: Subspace-Aware Prompt Adaptation for Robust Continual Learning in LLMsDinithi Jayasuriya, Sina Tayebati, Davide Ettori … Amit Ranjan TrivediIJCNN · University of Illinois Chicago · Intel (United States)
    PDF ↗
  5. 2024
    Multi-Modal Continual Pre-Training For Audio EncodersGyuhak Kim, Ho-Hsiang Wu, Luca Bondi, Bing LiuICASSP · University of Illinois Chicago · Robert Bosch (United States)
  6. 2024
    Disentangled Representations for Continual Learning: Overcoming Forgetting and Facilitating Knowledge TransferZhaopeng Xu, Qi Qin, Bing Liu, Dongyan ZhaoSpringer LNCS · Peking University · University of Illinois Chicago · +1
  7. 2023
    Dealing with Cross-Task Class Discrimination in Online Continual LearningYiduo Guo, Bing Liu, Dongyan ZhaoCVPR · Peking University · University of Illinois Chicago
    PDF ↗
  8. 2022
    Rebalancing Batch Normalization for Exemplar-Based Class-Incremental LearningSungmin Cha, Sungjun Cho, Dasol Hwang … Taesup MoonCVPR · Seoul National University · University of Illinois Chicago
    PDF ↗
  9. 2022
    AI Autonomy: Self-initiated Open-world Continual Learning and AdaptationBing Liu, Sahisnu Mazumder, Eric Robertson, Scott S. GrigsbyAI Magazine · University of Illinois Chicago · Intelligent Systems Research (United States) · +2
    PDF ↗
  10. 2023
    Unbiased and Efficient Self-Supervised Incremental Contrastive LearningCheng Ji, Jianxin Li, Hao Peng … Philip S. YuWSDM · Beihang University · Macquarie University · +1
    PDF ↗
  11. 2021
    Improving Gender Fairness of Pre-Trained Language Models without Catastrophic ForgettingZahra Fatemi, Xing Chen, Wenhao Liu, Caimming XiongACL · University of Illinois Chicago · University of Chicago · +1
    PDF ↗
  12. 2022
    Continual Learning Dialogue Systems - Learning during ConversationSahisnu Mazumder, Bing LiuSIGIR · Intel (United States) · University of Illinois Chicago
  13. 2022
    Adaptive Orthogonal Projection for Batch and Online Continual LearningYiduo Guo, Wenpeng Hu, Dongyan Zhao, Bing LiuAAAI · Peking University · King University · +1
  14. 2022
    Continual Learning Based on OOD Detection and Task MaskingGyuhak Kim, Sepideh Esmaeilpour, Changnan Xiao, Bing LiuCVPR · University of Illinois Chicago
    PDF ↗
  15. 2022
    Biological underpinnings for lifelong learning machinesDhireesha Kudithipudi, Mario Aguilar-Simon, Jonathan Babb … Hava T. SiegelmannNature Machine Intelligence · The University of Texas at San Antonio · Intelligent Systems Research (United States) · +24
    PDF ↗
  16. 2022
    Partially Relaxed Masks for Knowledge Transfer Without Forgetting in Continual LearningTatsuya Konishi, Mori Kurokawa, Chihiro Ono … Bing LiuSpringer LNCS · KDDI Research (Japan) · University of Illinois Chicago
  17. 2021
    Continual Learning for Named Entity RecognitionNatawut Monaikul, Giuseppe Castellucci, Simone Filice, Oleg RokhlenkoAAAI · University of Illinois Chicago · Amazon (Germany)
  18. 2021
    Lifelong and Continual Learning Dialogue Systems: Learning during ConversationBing Liu, Sahisnu MazumderAAAI · University of Illinois Chicago
  19. 2021
    Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNsYuwei Cao, Hao Peng, Jia Wu … Philip S. YuWWW · University of Illinois Chicago · Beihang University · +1
    PDF ↗
  20. 2021
    Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification TasksZixuan Ke, Hu Xu, Bing LiuNAACL · University of Illinois Chicago · Meta (Israel)
    PDF ↗
  21. 2021
    CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification TasksZixuan Ke, Bing Liu, Hu Xu, Lei ShuEMNLP · University of Illinois Chicago · Meta (Israel) · +1
    PDF ↗
  22. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  23. 2020
    Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the JobBing Liu, Sahisnu MazumderarXiv · University of Illinois Chicago
    PDF ↗
  24. 2020
    Learning on the Job: Online Lifelong and Continual LearningBing LiuAAAI · University of Illinois Chicago
  25. 2019
    Forward and Backward Knowledge Transfer for Sentiment ClassificationHao Wang, Bing Liu, Shuai Wang … Yan YangMachine Learning · Southwest Jiaotong University · University of Illinois Chicago
    PDF ↗
  26. 2018
    Lifelong Learning Memory Networks for Aspect Sentiment ClassificationShuai Wang, Guangyi Lv, Sahisnu Mazumder … Bing LiuIEEE International Conference on Big Data (Big Data) · University of Illinois Chicago · University of Science and Technology of China
  27. 2018
    Lifelong Machine Learning, Second EditionZhiyuan Chen, Bing LiuMachine Learning · Google (United States) · University of Illinois Chicago
  28. 2016
    Lifelong Machine LearningZhiyuan Chen, Bing LiuMachine Learning · Google (United States) · University of Illinois Chicago
  29. 2017
    Lifelong Learning CRF for Supervised Aspect ExtractionLei Shu, Hu Xu, Bing LiuACL · University of Illinois Chicago
    PDF ↗
  30. 2015
    Lifelong Machine Learning for Topic Modeling and BeyondZhiyuan ChenNAACL · University of Illinois Chicago
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.