Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

12 papers of 11,817Sort Recent · Most cited
  1. 2021
    A Unified Speaker Adaptation Approach for ASRYingzhu Zhao, Chongjia Ni, C. Leung … B. MaEMNLP
    PDF ↗
  2. 2021PDF ↗
  3. 2021
    Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine TranslationMozhdeh Gheini, Xiang Ren, Jonathan MayEMNLP · University of Southern California · California Southern University
    PDF ↗
  4. 2021
    Structural Adapters in Pretrained Language Models for AMR-to-Text GenerationLeonardo F. R. Ribeiro, Yue Zhang, Iryna GurevychEMNLP · Westlake University · Technische Universität Darmstadt · +2
    PDF ↗
  5. 2021
    CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification TasksZixuan Ke, Bing Liu, Hu Xu, Lei ShuEMNLP · University of Illinois Chicago · Meta (Israel) · +1
    PDF ↗
  6. 2021
    Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot LearningXisen Jin, Bill Yuchen Lin, Mohammad Rostami, Xiang RenEMNLP · University of Southern California · Biomedical Research Institute of Southern California · +1
    PDF ↗
  7. 2021
    Wav-BERT: Cooperative Acoustic and Linguistic Representation Learning for Low-Resource Speech RecognitionGuolin Zheng, Yubei Xiao, Ke Gong … Liang LinEMNLP · Sun Yat-sen University · ARC Centre of Excellence for Dark Matter Particle Physics
    PDF ↗
  8. 2021
    Total Recall: a Customized Continual Learning Method for Neural Semantic ParsersZhuang Li, Lizhen Qu, Gholamreza HaffariEMNLP · Monash University
    PDF ↗
  9. 2021
    Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation NetworksQingbin Liu, Pengfei Cao, Cao Liu … Jun ZhaoEMNLP · Chinese Academy of Sciences · Shandong Institute of Automation · +5
  10. 2021
    Improving the Quality Trade-Off for Neural Machine Translation Multi-Domain AdaptationEva Hasler, Tobias Domhan, Jonay Trénous … Felix HieberEMNLP · Amazon (Germany)
  11. 2021
    Lifelong Explainer for Lifelong LearnersXuelin Situ, Sameen Maruf, Ingrid Zukerman … Gholamreza HaffariEMNLP · Monash University · Commonwealth Scientific and Industrial Research Organisation · +2
  12. 2021
    Lifelong Event Detection with Knowledge TransferPengfei Yu, Heng Ji, P. NatarajanEMNLP
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.