Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

58 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2026
    Retrieval-Augmented Pseudo-Image Guided Alignment and Text Domain-Aware Memory Recall for Continual Zero-Shot CaptioningBing Liu, Wenjie Yang, Mingming Liu … Yong ZhouIEEE TCSVT · China University of Mining and Technology · Jiangsu Vocational Institute of Architectural Technology · +1
  2. 2026PDF ↗
  3. 2025
    Learning After Model DeploymentDerda Kaymak, Gyuhak Kim, Tomoya Kaichi … Bing LiuFrontiers · University of Illinois Chicago · Accenture (United States) · +1
    PDF ↗
  4. 2025PDF ↗
  5. 2025PDF ↗
  6. 2024
    In-context Continual Learning Assisted by an External Continual LearnerSaleh Momeni, Sahisnu Mazumder, Zixuan Ke, Bing LiuCOLING
    PDF ↗
  7. 2024PDF ↗
  8. 2024
    DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual LearningHaiyang Guo, Fei Zhu, Fanhu Zeng … Xu-Yao ZhangarXiv
    PDF ↗
  9. 2025PDF ↗
  10. 2024PDF ↗
  11. 2024
    L2A: Learning Affinity From Attention for Weakly Supervised Continual Semantic SegmentationHao Liu, Yong Zhou, Bing Liu … Joey Tianyi ZhouIEEE TCSVT · China University of Mining and Technology · Agency for Science, Technology and Research · +1
  12. 2024
    Multi-Modal Continual Pre-Training For Audio EncodersGyuhak Kim, Ho-Hsiang Wu, Luca Bondi, Bing LiuICASSP · University of Illinois Chicago · Robert Bosch (United States)
  13. 2024
    Disentangled Representations for Continual Learning: Overcoming Forgetting and Facilitating Knowledge TransferZhaopeng Xu, Qi Qin, Bing Liu, Dongyan ZhaoSpringer LNCS · Peking University · University of Illinois Chicago · +1
  14. 2024
    Continual Learning: Applications and the Road ForwardEli Verwimp, Rahaf Aljundi, Shai Ben-David … Gido M. van de VenTMLR
    PDF ↗
  15. 2023
    Sub-network Discovery and Soft-masking for Continual Learning of Mixed TasksZixuan Ke, Bing Liu, Wenhan Xiong … Haoran LiEMNLP
    PDF ↗
  16. 2024
    Class Incremental Learning via Likelihood Ratio Based Task PredictionHaowei Lin, Yijia Shao, Weinan Qian … Bing LiuICLR
    PDF ↗
  17. 2023
    Parameter-Level Soft-Masking for Continual LearningTatsuya Konishi, Mori Kurokawa, Chihiro Ono … Bing LiuICML
    PDF ↗
  18. 2023
    Learnability and Algorithm for Continual LearningGyuhak Kim, Changnan Xiao, Tatsuya Konishi, Bing LiuICML
    PDF ↗
  19. 2023
    Class-Incremental Learning based on Label GenerationYijia Shao, Yiduo Guo, Dongyan Zhao, Bing LiuACL
    PDF ↗
  20. 2023
    Dealing with Cross-Task Class Discrimination in Online Continual LearningYiduo Guo, Bing Liu, Dongyan ZhaoCVPR · Peking University · University of Illinois Chicago
    PDF ↗
  21. 2023
    AI Autonomy: Self-initiated Open-world Continual Learning and AdaptationBing Liu, Sahisnu Mazumder, Eric Robertson, Scott S. GrigsbyAI Magazine · University of Illinois Chicago · Intelligent Systems Research (United States) · +2
    PDF ↗
  22. 2023PDF ↗
  23. 2023
    Open-World Continual Learning: Unifying Novelty Detection and Continual LearningGyuhak Kim, Changnan Xiao, Tatsuya Konishi … Bing LiuArtificial Intelligence
    PDF ↗
  24. 2023
    Continual Pre-training of Language ModelsZixuan Ke, Yijia Shao, Haowei Lin … Bing LiuICLR
    PDF ↗
  25. 2023
    Distilled Meta-learning for Multi-Class Incremental LearningHao Liu, Zhaoyu Yan, Bing Liu … Abdulmotaleb El SaddikACM Transactions · China University of Mining and Technology · University of Ottawa
    PDF ↗
  26. 2023
    Deep Continual Learning (Dagstuhl Seminar 23122)T. Tuytelaars, Bing Liu, Vincenzo Lomonaco … Andrea CossuDagstuhl Reports
  27. 2022PDF ↗
  28. 2022PDF ↗
  29. 2022
    A Theoretical Study on Solving Continual LearningGyuhak Kim, Changnan Xiao, Tatsuya Konishi … Bing LiuNeurIPS
    PDF ↗
  30. 2022
    Continual Training of Language Models for Few-Shot LearningZixuan Ke, Haowei Lin, Yijia Shao … Bing LiuEMNLP
    PDF ↗
  31. 2022
    Incremental learning with neural networks for computer vision: a surveyHao Liu, Yong Zhou, Bing Liu … Zhiwen ShaoArtificial Intelligence Review · Ministry of Education of the People's Republic of China · China University of Mining and Technology
  32. 2022PDF ↗
  33. 2022
    Continual Learning Dialogue Systems - Learning during ConversationSahisnu Mazumder, Bing LiuSIGIR · Intel (United States) · University of Illinois Chicago
  34. 2022
    Adaptive Orthogonal Projection for Batch and Online Continual LearningYiduo Guo, Wenpeng Hu, Dongyan Zhao, Bing LiuAAAI · Peking University · King University · +1
  35. 2022
    Continual Learning Based on OOD Detection and Task MaskingGyuhak Kim, Sepideh Esmaeilpour, Changnan Xiao, Bing LiuCVPR · University of Illinois Chicago
    PDF ↗
  36. 2022
    Partially Relaxed Masks for Knowledge Transfer Without Forgetting in Continual LearningTatsuya Konishi, Mori Kurokawa, Chihiro Ono … Bing LiuSpringer LNCS · KDDI Research (Japan) · University of Illinois Chicago
  37. 2022
    AI Autonomy: Self-Initiation, Adaptation and Continual LearningBing Liu, Sahisnu Mazumder, Eric Robertson, Scott GrigsbyarXiv
  38. 2020PDF ↗
  39. 2021PDF ↗
  40. 2021
    Defeating Catastrophic Forgetting via Enhanced Orthogonal Weights ModificationYanni Li, Bing Liu, Kaicheng Yao … Jiangtao CuiarXiv
    PDF ↗
  41. 2021
    Continual Learning by Using Information of Each Class HolisticallyWenpeng Hu, Qi Qin, Mengyu Wang … Bing LiuAAAI · Peking University
  42. 2021
    Lifelong and Continual Learning Dialogue Systems: Learning during ConversationBing Liu, Sahisnu MazumderAAAI · University of Illinois Chicago
  43. 2021
    Continual Learning in Task-Oriented Dialogue SystemsAndrea Madotto, Zhaojiang Lin, Zhenpeng Zhou … Zhiguang WangEMNLP · Hong Kong University of Science and Technology · Meta (Israel) · +1
    PDF ↗
  44. 2021
    Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification TasksZixuan Ke, Hu Xu, Bing LiuNAACL · University of Illinois Chicago · Meta (Israel)
    PDF ↗
  45. 2021
    CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification TasksZixuan Ke, Bing Liu, Hu Xu, Lei ShuEMNLP · University of Illinois Chicago · Meta (Israel) · +1
    PDF ↗
  46. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  47. 2021
    BNS: Building Network Structures Dynamically for Continual LearningQi Qin, Han Peng, Wen-Rui Hu … Bing LiuNeurIPS
  48. 2020
    Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the JobBing Liu, Sahisnu MazumderarXiv · University of Illinois Chicago
    PDF ↗
  49. 2020
    Learning on the Job: Online Lifelong and Continual LearningBing LiuAAAI · University of Illinois Chicago
  50. 2020
    Using the Past Knowledge to Improve Sentiment ClassificationQi Qin, Wenpeng Hu, Bing LiuEMNLP · Peking University · King University
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.