Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3951–4000Sort Recent · Most cited
  1. 2021
    Generative Replay-based Continual Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramarXiv
    PDF ↗
  2. 2021
    Incremental Knowledge Based Question AnsweringYongqi Li, Wenjie Li, Liqiang NiearXiv
    PDF ↗
  3. 2020
    Learning Invariant Representation for Continual LearningGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiyarXiv · Eindhoven University of Technology · University of Twente
    PDF ↗
  4. 2021
    EEC: Learning to Encode and Regenerate Images for Continual LearningAli Ayub, Alan R. WagnerICLR · Pennsylvania State University
    PDF ↗
  5. 2021
    Rethinking Experience Replay: a Bag of Tricks for Continual LearningPietro Buzzega, Matteo Boschini, Angelo Porrello, Simone CalderaraICPR · University of Modena and Reggio Emilia
    PDF ↗
  6. 2021
    Class-incremental Learning with Pre-allocated Fixed ClassifiersFederico Pernici, Matteo Bruni, Claudio Baecchi … Alberto Del BimboICPR · Florence (Netherlands) · University of Florence
    PDF ↗
  7. 2021
    Sequential Domain Adaptation through Elastic Weight Consolidation for Sentiment AnalysisAvinash Madasu, Anvesh Rao VijjiniICPR · Samsung (United States) · Samsung (India)
    PDF ↗
  8. 2021
    ARCADe: A Rapid Continual Anomaly DetectorAhmed Frikha, Denis Krompaß, Volker TrespICPR · Siemens (Germany)
    PDF ↗
  9. 2021
    Incrementally Zero-Shot Detection by an Extreme Value AnalyzerSixiao Zheng, Yanwei Fu, Yanxi HouICPR · Fudan University
    PDF ↗
  10. 2021
    Pseudo Rehearsal using non photo-realistic imagesBhasker Sri Harsha Suri, Kalidas YeturuICPR · Indian Institute of Technology Tirupati
    PDF ↗
  11. 2019
    A Continual Learning Survey: Defying Forgetting in Classification TasksMatthias Delange, Rahaf Aljundi, Marc Masana … Tinne TuytelaarsTPAMI · Computer Vision Center · Huawei Technologies (Canada)
    PDF ↗
  12. 2021
    AdapterFusion: Non-Destructive Task Composition for Transfer LearningJonas Pfeiffer, Aishwarya Kamath, Andreas Rücklé … Iryna GurevychEACL · Technische Universität Darmstadt · Supélec · +5
    PDF ↗
  13. 2021
    K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersRuize Wang, Duyu Tang, Nan Duan … Ming ZhouACL · Fudan University · Microsoft (United States) · +1
    PDF ↗
  14. 2021
    Continual Learning in Task-Oriented Dialogue SystemsAndrea Madotto, Zhaojiang Lin, Zhenpeng Zhou … Zhiguang WangEMNLP · Hong Kong University of Science and Technology · Meta (Israel) · +1
    PDF ↗
  15. 2021
    Continual Learning for Text Classification with Information Disentanglement Based RegularizationYufan Huang, Yanzhe Zhang, Jiaao Chen … Diyi YangNAACL · Georgia Institute of Technology · Google (United States) · +1
    PDF ↗
  16. 2021
    Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification TasksZixuan Ke, Hu Xu, Bing LiuNAACL · University of Illinois Chicago · Meta (Israel)
    PDF ↗
  17. 2021
    InfoMax-GAN: Improved Adversarial Image Generation via Information Maximization and Contrastive LearningKwot Sin Lee, Ngoc-Trung Tran, Ngai‐Man CheungWACV · University of Cambridge · Snap (United States) · +1
    PDF ↗
  18. 2021
    AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive SummarizationTiezheng Yu, Zihan Liu, Pascale FungNAACL · Hong Kong University of Science and Technology
    PDF ↗
  19. 2020
    Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation ExtractionLi Cui, Deqing Yang, Jiaxin Yu … Yanghua XiaoACL · Fudan University
    PDF ↗
  20. 2021
    Posterior Meta-Replay for Continual LearningChristian Henning, Maria R. Cervera, Francesco D'Angelo … João SacramentoNeurIPS
    PDF ↗
  21. 2021
    Self-Supervised Training Enhances Online Continual LearningGianmarco J Gallardo, Tyler L. Hayes, Christopher KananBMVC
    PDF ↗
  22. 2021
    CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification TasksZixuan Ke, Bing Liu, Hu Xu, Lei ShuEMNLP · University of Illinois Chicago · Meta (Israel) · +1
    PDF ↗
  23. 2021
    Multilingual Machine Translation: Closing the Gap between Shared and Language-specific Encoder-DecodersCarlos Escolano, Marta R. Costa‐jussà, José A. R. Fonollosa, Mikel ArtetxeEACL · Universitat Politècnica de Catalunya · University of the Basque Country · +1
    PDF ↗
  24. 2021
    Learning Adaptive Embedding Considering Incremental ClassYang Yang, Zhen-Qiang Sun, Hengshu Zhu … Jian YangTKDE · Nanjing University of Science and Technology · Nanjing Normal University · +4
    PDF ↗
  25. 2021
    Towards Continual Learning for Multilingual Machine Translation via Vocabulary SubstitutionXavier García, Noah Constant, Ankur P. Parikh, Orhan FıratNAACL · Google (United States)
    PDF ↗
  26. 2021
    Continual Representation Learning for Biometric IdentificationBo Zhao, Shixiang Tang, Dapeng Chen … Rui ZhaoWACV · Group Sense (China) · University of Edinburgh · +1
    PDF ↗
  27. 2021
    L3DOC: Lifelong 3D Object ClassificationYuyang Liu, Yang Cong, Gan Sun … Hongsen LiuTIP · Shenyang Institute of Automation · Chinese Academy of Sciences · +1
    PDF ↗
  28. 2021
    Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot LearningXisen Jin, Bill Yuchen Lin, Mohammad Rostami, Xiang RenEMNLP · University of Southern California · Biomedical Research Institute of Southern California · +1
    PDF ↗
  29. 2021
    Prototype-based Incremental Few-Shot SegmentationFabio Cermelli, Massimiliano Mancini, Yongqin Xian … Barbara CaputoBMVC
    PDF ↗
  30. 2020
    Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and MaskingBinzong Geng, Fajie Yuan, Qiancheng Xu … Min YangACL · University of Science and Technology of China · Chinese Academy of Sciences · +7
    PDF ↗
  31. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  32. 2021
    Lifelong Event Detection with Knowledge TransferPengfei Yu, Heng Ji, Prem NatarajanEMNLP · University of Illinois Urbana-Champaign · Amazon (United States)
    PDF ↗
  33. 2021
    Continual Learning for Neural Machine TranslationYue Cao, Haoran Wei, Boxing Chen, Xiaojun WanNAACL · Peking University · Alibaba Group (United States)
    PDF ↗
  34. 2021
    Continual Learning at the Edge: Real-Time Training on Smartphone DevicesLorenzo Pellegrini, Vincenzo Lomonaco, Gabriele Graffieti, Davide MaltoniESANN 2021 proceedings · Azienda-Unita' Sanitaria Locale Di Cesena · University of Pisa · +1
    PDF ↗
  35. 2021
    Pruning-then-Expanding Model for Domain Adaptation of Neural Machine TranslationShuhao Gu, Yang Feng, Wanying XieNAACL · Chinese Academy of Sciences · Institute of Computing Technology · +2
    PDF ↗
  36. 2021
    Continual Learning for Grounded Instruction Generation by Observing Human Following BehaviorNoriyuki Kojima, Alane Suhr, Yoav ArtziTACL · Cornell University · Cornell Tech
    PDF ↗
  37. 2021
    Lifelong Learning of Hate Speech Classification on Social MediaJing Qian, Hong Wang, Mai ElSherief, Xifeng YanNAACL · Georgia Institute of Technology · University of California, Santa Barbara
    PDF ↗
  38. 2021
    Do not Forget to Attend to Uncertainty while Mitigating Catastrophic ForgettingVinod K Kurmi, Badri N. Patro, Venkatesh K. Subramanian, Vinay P. NamboodiriWACV · Indian Institute of Technology Kanpur · University of Bath
    PDF ↗
  39. 2021
    SPACE: Structured Compression and Sharing of Representational Space for Continual LearningGobinda Saha, Isha Garg, Aayush Ankit, Kaushik RoyIEEE Access · Purdue University West Lafayette
    PDF ↗
  40. 2020
    Learning to Solve NLP Tasks in an Incremental Number of LanguagesGiuseppe Castellucci, Simone Filice, Danilo Croce, Roberto BasiliACL · Amazon (United States) · Seattle University · +3
    PDF ↗
  41. 2020
    Rational LAMOL: A Rationale-based Lifelong Learning FrameworkKasidis Kanwatchara, Thanapapas Horsuwan, Piyawat Lertvittayakumjorn … Peerapon VateekulACL · Chulalongkorn University · Imperial College London
    PDF ↗
  42. 2021
    Preserving Cross-Linguality of Pre-trained Models via Continual LearningZihan Liu, Genta Indra Winata, Andrea Madotto, Pascale FungWorkshop on Representation Learning for NLP (RepL4NLP-2021) · Hong Kong University of Science and Technology
    PDF ↗
  43. 2021
    Overcoming Catastrophic Forgetting Using Sparse Coding and Meta LearningJulio Hurtado, Hans Löbel, Álvaro SotoIEEE Access · Pontificia Universidad Católica de Chile
    PDF ↗
  44. 2021
    Studying Catastrophic Forgetting in Neural Ranking ModelsJesús Lovón-Melgarejo, Laure Soulier, Karen Pinel-Sauvagnat, Lynda TamineSpringer LNCS · Université Toulouse III - Paul Sabatier · Institut de Recherche en Informatique de Toulouse · +4
    PDF ↗
  45. 2021
    Continual Learning with Echo State NetworksAndrea Cossu, Davide Bacciu, Antonio Carta … Vincenzo LomonacoESANN 2021 proceedings · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  46. 2021
    Total Recall: a Customized Continual Learning Method for Neural Semantic ParsersZhuang Li, Lizhen Qu, Gholamreza HaffariEMNLP · Monash University
    PDF ↗
  47. 2021
    Elastic weight consolidation for better bias inoculationJames Thorne, Andreas VlachosEACL · University of Cambridge
    PDF ↗
  48. 2021
    Mitigating Mode Collapse by Sidestepping Catastrophic ForgettingKarttikeya Mangalam, Rohin GargBMVC · University of California, Berkeley · Indian Institute of Technology Kanpur
    PDF ↗
  49. 2021
    Continual Learning with Differential PrivacyPradnya Desai, Phung Lai, NhatHai Phan, My T. ThaiSpringer CCIS · New Jersey Institute of Technology · University of Florida
    PDF ↗
  50. 2021
    Learning without Forgetting for 3D Point Cloud ObjectsTownim Faisal Chowdhury, Mahira Jalisha, Ali Cheraghian, Shafin RahmanSpringer LNCS · North South University · Australian National University · +2
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.