Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

11 papers of 11,817Sort Recent · Most cited
  1. 2020
    Continual Learning in Task-Oriented Dialogue SystemsAndrea Madotto, Zhaojiang Lin, Zhenpeng Zhou … Zhiguang WangEMNLP · Hong Kong University of Science and Technology · Meta (Israel) · +1
    PDF ↗
  2. 2020
    Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less ForgettingSanyuan Chen, Yutai Hou, Yiming Cui … Xiangzhan YuEMNLP · Harbin Institute of Technology · Joint Research Centre · +1
    PDF ↗
  3. 2020
    Continual Learning for Natural Language Generation in Task-oriented Dialog SystemsFei Mi, Liangwei Chen, Mengjie Zhao … Boi FaltingsEMNLP · École Polytechnique Fédérale de Lausanne · LMU Klinikum · +2
    PDF ↗
  4. 2020
    Efficient Meta Lifelong-Learning with Limited MemoryZirui Wang, Sanket Vaibhav Mehta, Barnabás Póczos, Jaime CarbonellEMNLP · Carnegie Mellon University
    PDF ↗
  5. 2020
    Disentangle-based Continual Graph Representation LearningXiaoyu Kou, Yankai Lin, Shaobo Liu … Yan ZhangEMNLP · Peking University · Tencent (China)
    PDF ↗
  6. 2020
    Incremental Event Detection via Knowledge Consolidation NetworksPengfei Cao, Yubo Chen, Jun Zhao, Taifeng WangEMNLP
  7. 2020PDF ↗
  8. 2020
    Visually Grounded Continual Learning of Compositional PhrasesXisen Jin, Junyi Du, Arka Sadhu … Xiang RenEMNLP · University of Southern California · California Southern University · +1
  9. 2020
    Using the Past Knowledge to Improve Sentiment ClassificationQi Qin, Wenpeng Hu, Bing LiuEMNLP · Peking University · King University
  10. 2020
    Continual Learning Long Short Term MemoryXin Guo, Yu Tian, Qinghan Xue … Xiaolong WangEMNLP · University of Delaware
  11. 2020
    Findings of the First Shared Task on Lifelong Learning Machine TranslationLoïc Barrault, Magdalena Biesialska, Marta R. Costa‐jussà … Olivier GalibertEMNLP · University of Sheffield · Universitat Politècnica de Catalunya · +2
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.