Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 2901–2950Sort Recent · Most cited
  1. 2023
    Overcoming Catastrophic Forgetting in Massively Multilingual Continual LearningGenta Indra Winata, Lingjue Xie, Karthik Radhakrishnan … Daniel Preoţiuc-PietroACL
    PDF ↗
  2. 2023
    Few-Shot Class-Incremental Audio Classification Using Dynamically Expanded Classifier With Self-Attention Modified PrototypesYanxiong Li, Wenchang Cao, Wei Xie … Emmanouil BenetosIEEE Trans. Multimedia · South China University of Technology · Queen Mary University of London
    PDF ↗
  3. 2023
    Fairness Continual Learning Approach to Semantic Scene Understanding in Open-World EnvironmentsThanh-Dat Truong, Hoang-Quan Nguyen, Bhiksha Raj, Khoa LuuNeurIPS
    PDF ↗
  4. 2023
    Condensed Prototype Replay for Class Incremental LearningJiangtao Kong, Zhenyu Zong, Tianyi Zhou, Huajie ShaoarXiv
    PDF ↗
  5. 2023
    Deep Reinforcement Learning with Plasticity InjectionEvgenii Nikishin, Junhyuk Oh, Georg Ostrovski … André Sales BarretoNeurIPS
    PDF ↗
  6. 2023
    Lightweight Learner for Shared Knowledge Lifelong LearningYunhao Ge, Yuecheng Li, Di Wu … Laurent IttiTMLR
    PDF ↗
  7. 2023
    IBCL: Zero-shot Model Generation under Stability-Plasticity Trade-offsPengyuan Lu, Michele Caprio, Eric Eaton, Inseop LeearXiv
    PDF ↗
  8. 2023
    Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data CurationDa Yin, Xiao Liu, Fan Yin … Kai-Wei ChangEMNLP
    PDF ↗
  9. 2023
    Continual Learning with Strong Experience ReplayTao Zhuo, Zhiyong Cheng, Zan Gao … Kankanhalli, MohanarXiv
    PDF ↗
  10. 2023
    Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language UnderstandingUmberto Cappellazzo, Muqiao Yang, Daniele Falavigna, Alessio BruttiInterspeech
    PDF ↗
  11. 2023
    Continual Dialogue State Tracking via Example-Guided Question AnsweringHyundong Cho, Andrea Madotto, Zhaojiang Lin … Chinnadhurai SankarEMNLP
    PDF ↗
  12. 2023PDF ↗
  13. 2023PDF ↗
  14. 2023
    AI Autonomy: Self-initiated Open-world Continual Learning and AdaptationBing Liu, Sahisnu Mazumder, Eric Robertson, Scott S. GrigsbyAI Magazine · University of Illinois Chicago · Intelligent Systems Research (United States) · +2
    PDF ↗
  15. 2023
    Lifelong Language Pretraining with Distribution-Specialized ExpertsWuyang Chen, Yanqi Zhou, Nan Du … C. C. Iuras ̧cuICML
    PDF ↗
  16. 2023PDF ↗
  17. 2023
    Continual Learning with Invertible Generative ModelsJary Pomponi, Simone Scardapane, Aurelio UnciniNeural Networks · Sapienza University of Rome
    PDF ↗
  18. 2023
    Mode-Aware Continual Learning for Conditional Generative Adversarial NetworksCat P. Le, Juncheng Dong, Ahmed Aloui, Vahid TarokharXiv
    PDF ↗
  19. 2023PDF ↗
  20. 2023PDF ↗
  21. 2023
    Sharing Lifelong Reinforcement Learning Knowledge via Modulating MasksSaptarshi Nath, Christos Peridis, Eseoghene Ben-Iwhiwhu … Andrea SoltoggioCoLLAs
    PDF ↗
  22. 2023PDF ↗
  23. 2023PDF ↗
  24. 2023
    Increasing Depth of Neural Networks for Life-long LearningJędrzej Kozal, Michał WoźniakInformation Fusion · Wrocław University of Science and Technology · AGH University of Krakow
    PDF ↗
  25. 2023
    Online Continual Learning Without the Storage ConstraintAmeya Prabhu, Zhipeng Cai, Puneet K. Dokania … Ozan ŞenerarXiv
    PDF ↗
  26. 2023
    Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language ModelsBoxi Cao, Qiaoyu Tang, Hongyu Lin … Le SunInternational Conference on Language Resources and Evalua…
    PDF ↗
  27. 2024
    Continual Multimodal Knowledge Graph ConstructionXiang Chen, Jintian Zhang, Xiaohan Wang … Huajun ChenIJCAI
    PDF ↗
  28. 2023
    Learning Non-linguistic Skills without Sacrificing Linguistic ProficiencyMandar Sharma, Nikhil Muralidhar, Naren RamakrishnanACL
    PDF ↗
  29. 2023
    Continual Learning for End-to-End ASR by Averaging Domain ExpertsPeter Plantinga, Jaekwon Yoo, Chandra DhirarXiv
    PDF ↗
  30. 2023
    RepCL: Exploring Effective Representation for Continual Text ClassificationYifan Song, Peiyi Wang, Dawei Zhu … Sujian LiarXiv
    PDF ↗
  31. 2023PDF ↗
  32. 2023PDF ↗
  33. 2023
    Domain Incremental Lifelong Learning in an Open WorldYi Dai, Hao Lang, Yinhe Zheng … Yongbin LiACL
    PDF ↗
  34. 2023PDF ↗
  35. 2023
    Accelerating Batch Active Learning Using Continual Learning TechniquesArnav Das, Gantavya Bhatt, Megh Manoj Bhalerao … Jeff BilmesTMLR
    PDF ↗
  36. 2023
    Continual Facial Expression Recognition: A BenchmarkNikhil Churamani, Tolga Dimlioglu, G. I. Parisi, H. GunesarXiv
    PDF ↗
  37. 2023
    SRIL: Selective Regularization for Class-Incremental LearningJisu Han, Jaemin Na, Wonjun HwangAsian Conference on Computer Vision
    PDF ↗
  38. 2023
    Continual learning with Bayesian model based on a fixed pre-trained feature extractorYang Yang, Zhiying Cui, Junjie Xu … Ruixuan WangVisual Intelligence · Sun Yat-sen University · Peng Cheng Laboratory · +1
    PDF ↗
  39. 2023
    BiRT: Bio-inspired Replay in Vision Transformers for Continual LearningKishaan Jeeveswaran, Prashant Bhat, Bahram Zonooz, Elahe AraniICML
    PDF ↗
  40. 2023PDF ↗
  41. 2023
    Learnable Distribution Calibration for Few-Shot Class-Incremental LearningBinghao Liu, Boyu Yang, Lingxi Xie … Qixiang YeTPAMI · University of Chinese Academy of Sciences · Huawei Technologies (China)
    PDF ↗
  42. 2019
    Spiking Neural Predictive Coding for Continual Learning from Data StreamsAlexander G. OrorbiaNeurocomputing · Rochester Institute of Technology
    PDF ↗
  43. 2023PDF ↗
  44. 2023
    Lifelong learning on evolving graphs under the constraints of imbalanced classes and new classesLukas Galke, Iacopo Vagliano, Benedikt Franke … Ansgar ScherpNeural Networks · Max Planck Institute for Psycholinguistics · Amsterdam University Medical Centers · +3
    PDF ↗
  45. 2023PDF ↗
  46. 2023
    Towards Adversarially Robust Continual LearningTao Bai, Chen Chen, Lingjuan Lyu … Bihan WenICASSP · Nanyang Technological University · Zhejiang University of Science and Technology · +2
    PDF ↗
  47. 2023
    Continual Learning for On-Device Speech Recognition Using Disentangled ConformersAnuj Diwan, Ching-Feng Yeh, Wei-Ning Hsu … Abdelrahman MohamedICASSP · The University of Texas at Austin
    PDF ↗
  48. 2023
    Centroid Distance Distillation for Effective Rehearsal in Continual LearningDaofeng Liu, Fan Lyu, Linyan Li … Fuyuan HuICASSP · Suzhou University of Science and Technology · Tianjin University · +1
    PDF ↗
  49. 2023
    Federated Self-Learning with Weak Supervision for Speech RecognitionMilind Rao, Gopinath Chennupati, Gautam Tiwari … Jasha DroppoICASSP · Amazon (United States)
    PDF ↗
  50. 2023
    Is Multi-Task Learning an Upper Bound for Continual Learning?Zihao Wu, Huy Tran, Hamed Pirsiavash, Soheil KolouriICASSP · Vanderbilt University · University of California, Davis
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.