Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

53 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2026
  2. 2026
  3. 2026PDF ↗
  4. 2025PDF ↗
  5. 2025
    Learning After Model DeploymentDerda Kaymak, Gyuhak Kim, Tomoya Kaichi … Bing LiuEuropean Conference on Artificial Intelligence
    PDF ↗
  6. 2025PDF ↗
  7. 2025
  8. 2024PDF ↗
  9. 2024
    In-context Continual Learning Assisted by an External Continual LearnerS. Momeni, Sahisnu Mazumder, Zixuan Ke, Bing LiuCOLING
    PDF ↗
  10. 2024PDF ↗
  11. 2024
    DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual LearningHaiyang Guo, Fei Zhu, Fanhu Zeng … Xu-Yao ZhangarXiv
    PDF ↗
  12. 2024PDF ↗
  13. 2024PDF ↗
  14. 2024
    Multi-Modal Continual Pre-Training For Audio EncodersGyuhak Kim, Ho-Hsiang Wu, Luca Bondi, Bing LiuICASSP
  15. 2024
  16. 2023
    Continual Learning: Applications and the Road ForwardEli Verwimp, S. Ben-David, Matthias Bethge … Gido M. van de VenTrans. Mach. Learn. Res.
    PDF ↗
  17. 2023
    Sub-network Discovery and Soft-masking for Continual Learning of Mixed TasksZixuan Ke, Bing Liu, Wenhan Xiong … Haoran LiEMNLP
    PDF ↗
  18. 2023
    Class Incremental Learning via Likelihood Ratio Based Task PredictionHaowei Lin, Yijia Shao, W. Qian … Bing LiuICLR
    PDF ↗
  19. 2023PDF ↗
  20. 2022
    AI Autonomy: Self-initiated Open-world Continual Learning and AdaptationBing Liu, Sahisnu Mazumder, Eric Robertson, Scott S. GrigsbyAI Magazine · University of Illinois Chicago · Intelligent Systems Research (United States) · +2
    PDF ↗
  21. 2023
    Distilled Meta-learning for Multi-Class Incremental LearningHao Liu, Zhaoyu Yan, Bing Liu … Abdulmotaleb El SaddikACM Trans. Multim. Comput. Commun. Appl.
  22. 2023
    Deep Continual Learning (Dagstuhl Seminar 23122)T. Tuytelaars, Bing Liu, Vincenzo Lomonaco … Andrea CossuDagstuhl Reports
  23. 2022PDF ↗
  24. 2022PDF ↗
  25. 2022
    A Theoretical Study on Solving Continual LearningGyuhak Kim, Changnan Xiao, Tatsuya Konishi … Bing LiuNeurIPS
    PDF ↗
  26. 2022
    Incremental learning with neural networks for computer vision: a surveyHao Liu, Yong Zhou, Bing Liu … Zhiwen ShaoArtificial Intelligence Review · Ministry of Education of the People's Republic of China · China University of Mining and Technology
  27. 2022PDF ↗
  28. 2022
    Continual Learning Dialogue Systems - Learning during ConversationSahisnu Mazumder, Bing LiuSIGIR · Intel (United States) · University of Illinois Chicago
  29. 2022
    Adaptive Orthogonal Projection for Batch and Online Continual LearningYiduo Guo, Wenpeng Hu, Dongyan Zhao, Bing LiuAAAI · Peking University · King University · +1
  30. 2022
    Continual Learning Based on OOD Detection and Task MaskingGyuhak Kim, Sepideh Esmaeilpour, Changnan Xiao, Bing LiuCVPR · University of Illinois Chicago
    PDF ↗
  31. 2022
    AI Autonomy: Self-Initiation, Adaptation and Continual LearningBing Liu, Sahisnu Mazumder, Eric Robertson, Scott GrigsbyarXiv
  32. 2021PDF ↗
  33. 2021PDF ↗
  34. 2021
    Defeating Catastrophic Forgetting via Enhanced Orthogonal Weights ModificationYanni Li, Bing Liu, Kaicheng Yao … Jiangtao CuiarXiv
    PDF ↗
  35. 2021
    Continual Learning by Using Information of Each Class HolisticallyWenpeng Hu, Qi Qin, Mengyu Wang … Bing LiuAAAI · Peking University
  36. 2021
    Lifelong and Continual Learning Dialogue Systems: Learning during ConversationBing Liu, Sahisnu MazumderAAAI · University of Illinois Chicago
  37. 2020
    Continual Learning in Task-Oriented Dialogue SystemsAndrea Madotto, Zhaojiang Lin, Zhenpeng Zhou … Zhiguang WangEMNLP · Hong Kong University of Science and Technology · Meta (Israel) · +1
    PDF ↗
  38. 2021
    Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification TasksZixuan Ke, Hu Xu, Bing LiuNAACL · University of Illinois Chicago · Meta (Israel)
    PDF ↗
  39. 2021
    CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification TasksZixuan Ke, Bing Liu, Hu Xu, Lei ShuEMNLP · University of Illinois Chicago · Meta (Israel) · +1
    PDF ↗
  40. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  41. 2021
    BNS: Building Network Structures Dynamically for Continual LearningQi Qin, Han Peng, Wen-Rui Hu … Bing LiuNeurIPS
  42. 2020
    Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the JobBing Liu, Sahisnu MazumderarXiv · University of Illinois Chicago
    PDF ↗
  43. 2020
    Learning on the Job: Online Lifelong and Continual LearningBing LiuAAAI · University of Illinois Chicago
  44. 2020
    Using the Past Knowledge to Improve Sentiment ClassificationQi Qin, Wenpeng Hu, Bing LiuEMNLP · Peking University · King University
  45. 2020
  46. 2019
  47. 2019
    Forward and Backward Knowledge Transfer for Sentiment ClassificationHao Wang, Bing Liu, Shuai Wang … Yan YangMachine Learning · Southwest Jiaotong University · University of Illinois Chicago
    PDF ↗
  48. 2018
    Lifelong Learning Memory Networks for Aspect Sentiment ClassificationShuai Wang, Guangyi Lv, Sahisnu Mazumder … Bing LiuIEEE International Conference on Big Data (Big Data) · University of Illinois Chicago · University of Science and Technology of China
  49. 2018
  50. 2018
    Online Incremental Learning for Speaker-Adaptive Language ModelsChih Chi Hu, Bing Liu, John Paul Shen, Ian LaneInterspeech
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.