Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

9 papers of 11,817Sort Recent · Most cited
  1. 2021
    Improving Gender Fairness of Pre-Trained Language Models without Catastrophic ForgettingZahra Fatemi, Xing Chen, Wenhao Liu, Caimming XiongACL · University of Illinois Chicago · University of Chicago · +1
    PDF ↗
  2. 2021
    YANMTT: Yet Another Neural Machine Translation ToolkitRaj Dabre, Diptesh Kanojia, Chinmay Sawant, Eiichiro SumitaACL · Surrey Place Centre · National Institute of Information and Communications Technology · +1
    PDF ↗
  3. 2021
    Composable Sparse Fine-Tuning for Cross-Lingual TransferAlan Ansell, Edoardo Maria Ponti, Anna Korhonen, Ivan VulićACL · University of Cambridge · Language Science (South Korea) · +2
    PDF ↗
  4. 2021
    Enhancing Natural Language Representation with Large-Scale Out-of-Domain CommonsenseWanyun Cui, Xingran ChenACL · Shanghai University of Finance and Economics
    PDF ↗
  5. 2021
    Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation ExtractionLi Cui, Deqing Yang, Jiaxin Yu … Yanghua XiaoACL · Fudan University
  6. 2021
    Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and MaskingBinzong Geng, Fajie Yuan, Qiancheng Xu … Min YangACL · University of Science and Technology of China · Chinese Academy of Sciences · +7
    PDF ↗
  7. 2021
    Learning to Solve NLP Tasks in an Incremental Number of LanguagesGiuseppe Castellucci, Simone Filice, Danilo Croce, Roberto BasiliACL · Amazon (United States) · Seattle University · +3
  8. 2021
    Rational LAMOL: A Rationale-based Lifelong Learning FrameworkKasidis Kanwatchara, Thanapapas Horsuwan, Piyawat Lertvittayakumjorn … Peerapon VateekulACL · Chulalongkorn University · Imperial College London
  9. 2021
    Transfer Learning for Sequence Generation: from Single-source to Multi-sourceXuancheng Huang, Jingfang Xu, Maosong Sun, Yang LiuACL · King Center · Tsinghua University · +2
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.