Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

12 papers of 11,817Sort Recent · Most cited
  1. 2022
    Preventing Catastrophic Forgetting in Continual Learning of New Natural Language TasksSudipta Kar, Giuseppe Castellucci, Simone Filice … Oleg RokhlenkoKDD · Amazon (United States)
    PDF ↗
  2. 2022
    ILASR: Privacy-Preserving Incremental Learning for Automatic Speech Recognition at Production ScaleGopinath Chennupati, Milind Rao, Gurpreet Chadha … Pankaj SitpureKDD · Amazon (United States)
    PDF ↗
  3. 2022
    Overcoming Catastrophic Forgetting During Domain Adaptation of Seq2seq Language GenerationDingcheng Li, Zheng Chen, Eunah Cho … Yang LiuNAACL · Amazon (United States)
  4. 2022
    Learning Representations for New Sound Classes With Continual Self-Supervised LearningZhepei Wang, Cem Subakan, Xilin Jiang … Paris SmaragdisIEEE Signal Processing Letters · University of Illinois Urbana-Champaign · Concordia University · +2
    PDF ↗
  5. 2021
    SynthASR: Unlocking Synthetic Data for Speech RecognitionAmin Fazel, Wei Yang, Yulan Liu … Jasha DroppoInterspeech · Samsung (South Korea) · Amazon (United States) · +1
    PDF ↗
  6. 2021
    CIFDM: Continual and Interactive Feature Distillation for Multi-Label Stream LearningYigong Wang, Zhuoyi Wang, Yu Lin … Dingcheng LiSIGIR · The University of Texas at Dallas · Amazon (United States)
  7. 2021
    CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification TasksZixuan Ke, Bing Liu, Hu Xu, Lei ShuEMNLP · University of Illinois Chicago · Meta (Israel) · +1
    PDF ↗
  8. 2021
    Learning to Solve NLP Tasks in an Incremental Number of LanguagesGiuseppe Castellucci, Simone Filice, Danilo Croce, Roberto BasiliACL · Amazon (United States) · Seattle University · +3
  9. 2021
    Combining Weakly Supervised ML Techniques for Low-Resource NLUVíctor Soto, Konstantine ArkoudasNAACL · Amazon (United States)
  10. 2019
    Semi-Supervised Learning for Text Classification by Layer PartitioningAlexander Hanbo Li, Abhinav SethyICASSP · Amazon (United States)
    PDF ↗
  11. 2020
    Incremental Few-Shot Meta-learning via Indirect Discriminant AlignmentQing Liu, Orchid Majumder, Alessandro Achille … Stefano SoattoSpringer LNCS · Johns Hopkins University · Amazon (United States)
  12. 2020
    M2KD: Incremental Learning via Multi-model and Multi-level Knowledge DistillationPeng Zhou, Long Mai, Jianming Zhang … Larry S. DavisBMVC · Beth Israel Deaconess Medical Center · Adobe Systems (United States) · +2
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.