Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

958 papers of 6,984 · showing 551–600Sort Recent · Most cited
  1. 2023
    Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data CurationDa Yin, Xiao Liu, Fan Yin … Kai-Wei ChangEMNLP
    PDF ↗
  2. 2023
    Continual Learning with Strong Experience ReplayTao Zhuo, Zhiyong Cheng, Zan Gao … Kankanhalli, MohanarXiv
    PDF ↗
  3. 2023
    Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language UnderstandingUmberto Cappellazzo, Muqiao Yang, Daniele Falavigna, Alessio BruttiInterspeech
    PDF ↗
  4. 2023
    Continual Dialogue State Tracking via Example-Guided Question AnsweringHyundong Cho, Andrea Madotto, Zhaojiang Lin … Chinnadhurai SankarEMNLP
    PDF ↗
  5. 2023PDF ↗
  6. 2023
    Overcome STSF phenomenon in catastrophic forgettingYifan Chang, Qifan ZhaoInternational Conference on Computer Graphics, Artificial…
  7. 2023PDF ↗
  8. 2023
    AI Autonomy: Self-initiated Open-world Continual Learning and AdaptationBing Liu, Sahisnu Mazumder, Eric Robertson, Scott S. GrigsbyAI Magazine · University of Illinois Chicago · Intelligent Systems Research (United States) · +2
    PDF ↗
  9. 2023
    Lifelong Language Pretraining with Distribution-Specialized ExpertsWuyang Chen, Yanqi Zhou, Nan Du … C. C. Iuras ̧cuICML
    PDF ↗
  10. 2023PDF ↗
  11. 2023
    A Fully Distributed Training for Class Incremental Learning in Multihead NetworksMingjun Dai, Yonghao Kong, Junpei Zhong … Hui WangIEEE INFOCOM 2023 - IEEE Conference on Computer Communica… · Shenzhen University · Ubiquitous Energy (United States) · +2
  12. 2023
    Continual Learning with Invertible Generative ModelsJary Pomponi, Simone Scardapane, Aurelio UnciniNeural Networks · Sapienza University of Rome
    PDF ↗
  13. 2023
    Decoupled Two-Phase Framework for Class-Incremental Few-Shot Named Entity RecognitionYifan Chen, Zhen Huang, Minghao Hu … Xicheng LuTsinghua Science & Technology · National University of Defense Technology · PLA Academy of Military Science
  14. 2023
    Mode-Aware Continual Learning for Conditional Generative Adversarial NetworksCat P. Le, Juncheng Dong, Ahmed Aloui, Vahid TarokharXiv
    PDF ↗
  15. 2023PDF ↗
  16. 2023PDF ↗
  17. 2023
    Sharing Lifelong Reinforcement Learning Knowledge via Modulating MasksSaptarshi Nath, Christos Peridis, Eseoghene Ben-Iwhiwhu … Andrea SoltoggioCoLLAs
    PDF ↗
  18. 2023PDF ↗
  19. 2023PDF ↗
  20. 2023
    Increasing Depth of Neural Networks for Life-long LearningJędrzej Kozal, Michał WoźniakInformation Fusion · Wrocław University of Science and Technology · AGH University of Krakow
    PDF ↗
  21. 2023
    Cross Domain Lifelong Learning Based on Task SimilarityShuojin Yang, Zhanchuan CaiTPAMI · Macau University of Science and Technology
  22. 2023
    Online Continual Learning Without the Storage ConstraintAmeya Prabhu, Zhipeng Cai, Puneet K. Dokania … Ozan ŞenerarXiv
    PDF ↗
  23. 2023
    Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language ModelsBoxi Cao, Qiaoyu Tang, Hongyu Lin … Le SunInternational Conference on Language Resources and Evalua…
    PDF ↗
  24. 2023
    Learning Non-linguistic Skills without Sacrificing Linguistic ProficiencyMandar Sharma, Nikhil Muralidhar, Naren RamakrishnanACL
    PDF ↗
  25. 2023
    Continuous transfer of neural network representational similarity for incremental learningSongsong Tian, Weijun Li, Xin Ning … Prayag TiwariNeurocomputing · Chinese Academy of Sciences · Institute of Semiconductors · +2
  26. 2023
    Continual Learning for End-to-End ASR by Averaging Domain ExpertsPeter Plantinga, Jaekwon Yoo, Chandra DhirarXiv
    PDF ↗
  27. 2023
    RepCL: Exploring Effective Representation for Continual Text ClassificationYifan Song, Peiyi Wang, Dawei Zhu … Sujian LiarXiv
    PDF ↗
  28. 2023PDF ↗
  29. 2023PDF ↗
  30. 2023
    Domain Incremental Lifelong Learning in an Open WorldYi Dai, Hao Lang, Yinhe Zheng … Yongbin LiACL
    PDF ↗
  31. 2023
    Multi-granularity knowledge distillation and prototype consistency regularization for class-incremental learningYanyan Shi, Dianxi Shi, Dianxi Shi … Chunping QiuNeural Networks · National University of Defense Technology · National Defense University
  32. 2023PDF ↗
  33. 2023
    Accelerating Batch Active Learning Using Continual Learning TechniquesArnav Das, Gantavya Bhatt, Megh Manoj Bhalerao … Jeff BilmesTMLR
    PDF ↗
  34. 2023PDF ↗
  35. 2023
    Continual Facial Expression Recognition: A BenchmarkNikhil Churamani, Tolga Dimlioglu, G. I. Parisi, H. GunesarXiv
    PDF ↗
  36. 2023
    SRIL: Selective Regularization for Class-Incremental LearningJisu Han, Jaemin Na, Wonjun HwangAsian Conference on Computer Vision
    PDF ↗
  37. 2023
    Continual learning with Bayesian model based on a fixed pre-trained feature extractorYang Yang, Zhiying Cui, Junjie Xu … Ruixuan WangVisual Intelligence · Sun Yat-sen University · Peng Cheng Laboratory · +1
    PDF ↗
  38. 2023
    BiRT: Bio-inspired Replay in Vision Transformers for Continual LearningKishaan Jeeveswaran, Prashant Bhat, Bahram Zonooz, Elahe AraniICML
    PDF ↗
  39. 2023PDF ↗
  40. 2023
    Learnable Distribution Calibration for Few-Shot Class-Incremental LearningBinghao Liu, Boyu Yang, Lingxi Xie … Qixiang YeTPAMI · University of Chinese Academy of Sciences · Huawei Technologies (China)
    PDF ↗
  41. 2023PDF ↗
  42. 2023
    Lifelong learning on evolving graphs under the constraints of imbalanced classes and new classesLukas Galke, Iacopo Vagliano, Benedikt Franke … Ansgar ScherpNeural Networks · Max Planck Institute for Psycholinguistics · Amsterdam University Medical Centers · +3
    PDF ↗
  43. 2023PDF ↗
  44. 2023
    Towards Adversarially Robust Continual LearningTao Bai, Chen Chen, Lingjuan Lyu … Bihan WenICASSP · Nanyang Technological University · Zhejiang University of Science and Technology · +2
    PDF ↗
  45. 2023
    Class-Incremental Learning on Multivariate Time Series Via Shape-Aligned Temporal DistillationZhongzheng Qiao, Minghui Hu, Xudong Jiang … Savitha RamasamyICASSP · Nanyang Technological University · Institute for Infocomm Research · +1
    PDF ↗
  46. 2023
    Continual Learning for On-Device Speech Recognition Using Disentangled ConformersAnuj Diwan, Ching-Feng Yeh, Wei-Ning Hsu … Abdelrahman MohamedICASSP · The University of Texas at Austin
    PDF ↗
  47. 2023
    Quantifying Catastrophic Forgetting in Continual Federated LearningChristophe Dupuy, Jimit Majmudar, Jixuan Wang … Salman AvestimehrICASSP · Amazon (United States) · University of Southern California · +1
  48. 2023
    Uncertainty-Aware Few-Shot Class-Incremental LearningJiancai Zhu, Jiabao Zhao, Jiayi Zhou … Zhi ZhangICASSP · East China Normal University · New York University Shanghai · +1
  49. 2023
    Centroid Distance Distillation for Effective Rehearsal in Continual LearningDaofeng Liu, Fan Lyu, Linyan Li … Fuyuan HuICASSP · Suzhou University of Science and Technology · Tianjin University · +1
    PDF ↗
  50. 2023
    Federated Self-Learning with Weak Supervision for Speech RecognitionMilind Rao, Gopinath Chennupati, Gautam Tiwari … Jasha DroppoICASSP · Amazon (United States)
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.