Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

442 papers of 8,653 · showing 351–400Sort Recent · Most cited
  1. 2021
    Multilingual Machine Translation: Closing the Gap between Shared and Language-specific Encoder-DecodersCarlos Escolano, Marta R. Costa‐jussà, José A. R. Fonollosa, Mikel ArtetxeEACL · Universitat Politècnica de Catalunya · University of the Basque Country · +1
    PDF ↗
  2. 2021
    Learning Adaptive Embedding Considering Incremental ClassYang Yang, Zhen-Qiang Sun, Hengshu Zhu … Jian YangTKDE · Nanjing University of Science and Technology · Nanjing Normal University · +4
    PDF ↗
  3. 2021
    Towards Continual Learning for Multilingual Machine Translation via Vocabulary SubstitutionXavier García, Noah Constant, Ankur P. Parikh, Orhan FıratNAACL · Google (United States)
    PDF ↗
  4. 2021
    Continual Representation Learning for Biometric IdentificationBo Zhao, Shixiang Tang, Dapeng Chen … Rui ZhaoWACV · Group Sense (China) · University of Edinburgh · +1
    PDF ↗
  5. 2021
    L3DOC: Lifelong 3D Object ClassificationYuyang Liu, Yang Cong, Gan Sun … Hongsen LiuTIP · Shenyang Institute of Automation · Chinese Academy of Sciences · +1
    PDF ↗
  6. 2021
    Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot LearningXisen Jin, Bill Yuchen Lin, Mohammad Rostami, Xiang RenEMNLP · University of Southern California · Biomedical Research Institute of Southern California · +1
    PDF ↗
  7. 2021
    Prototype-based Incremental Few-Shot SegmentationFabio Cermelli, Massimiliano Mancini, Yongqin Xian … Barbara CaputoBMVC
    PDF ↗
  8. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  9. 2021
    Lifelong Event Detection with Knowledge TransferPengfei Yu, Heng Ji, Prem NatarajanEMNLP · University of Illinois Urbana-Champaign · Amazon (United States)
    PDF ↗
  10. 2021
    Continual Learning for Neural Machine TranslationYue Cao, Haoran Wei, Boxing Chen, Xiaojun WanNAACL · Peking University · Alibaba Group (United States)
  11. 2021
    Continual Learning at the Edge: Real-Time Training on Smartphone DevicesLorenzo Pellegrini, Vincenzo Lomonaco, Gabriele Graffieti, Davide MaltoniESANN 2021 proceedings · Azienda-Unita' Sanitaria Locale Di Cesena · University of Pisa · +1
    PDF ↗
  12. 2021
    Pruning-then-Expanding Model for Domain Adaptation of Neural Machine TranslationShuhao Gu, Yang Feng, Wanying XieNAACL · Chinese Academy of Sciences · Institute of Computing Technology · +2
    PDF ↗
  13. 2021
    Continual Learning for Grounded Instruction Generation by Observing Human Following BehaviorNoriyuki Kojima, Alane Suhr, Yoav ArtziTACL · Cornell University · Cornell Tech
    PDF ↗
  14. 2021
    Lifelong Learning of Hate Speech Classification on Social MediaJing Qian, Hong Wang, Mai ElSherief, Xifeng YanNAACL · Georgia Institute of Technology · University of California, Santa Barbara
    PDF ↗
  15. 2021
    Do not Forget to Attend to Uncertainty while Mitigating Catastrophic ForgettingVinod K Kurmi, Badri N. Patro, Venkatesh K. Subramanian, Vinay P. NamboodiriWACV · Indian Institute of Technology Kanpur · University of Bath
    PDF ↗
  16. 2021
    SPACE: Structured Compression and Sharing of Representational Space for Continual LearningGobinda Saha, Isha Garg, Aayush Ankit, Kaushik RoyIEEE Access · Purdue University West Lafayette
    PDF ↗
  17. 2021
    Preserving Cross-Linguality of Pre-trained Models via Continual LearningZihan Liu, Genta Indra Winata, Andrea Madotto, Pascale FungWorkshop on Representation Learning for NLP (RepL4NLP-2021) · Hong Kong University of Science and Technology
  18. 2021
    Overcoming Catastrophic Forgetting Using Sparse Coding and Meta LearningJulio Hurtado, Hans Löbel, Álvaro SotoIEEE Access · Pontificia Universidad Católica de Chile
  19. 2021
    Studying Catastrophic Forgetting in Neural Ranking ModelsJesús Lovón-Melgarejo, Laure Soulier, Karen Pinel-Sauvagnat, Lynda TamineSpringer LNCS · Université Toulouse III - Paul Sabatier · Institut de Recherche en Informatique de Toulouse · +4
    PDF ↗
  20. 2021
    Continual Learning with Echo State NetworksAndrea Cossu, Davide Bacciu, Antonio Carta … Vincenzo LomonacoESANN 2021 proceedings · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  21. 2021
    Total Recall: a Customized Continual Learning Method for Neural Semantic ParsersZhuang Li, Lizhen Qu, Gholamreza HaffariEMNLP · Monash University
    PDF ↗
  22. 2021
    Elastic weight consolidation for better bias inoculationJames Thorne, Andreas VlachosEACL · University of Cambridge
    PDF ↗
  23. 2021
    Mitigating Mode Collapse by Sidestepping Catastrophic ForgettingKarttikeya Mangalam, Rohin GargBMVC · University of California, Berkeley · Indian Institute of Technology Kanpur
    PDF ↗
  24. 2021
    Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation NetworksQingbin Liu, Pengfei Cao, Cao Liu … Jun ZhaoEMNLP · Chinese Academy of Sciences · Shandong Institute of Automation · +5
  25. 2021
    Continual Learning with Differential PrivacyPradnya Desai, Phung Lai, NhatHai Phan, My T. ThaiSpringer CCIS · New Jersey Institute of Technology · University of Florida
    PDF ↗
  26. 2021
    Learning without Forgetting for 3D Point Cloud ObjectsTownim Faisal Chowdhury, Mahira Jalisha, Ali Cheraghian, Shafin RahmanSpringer LNCS · North South University · Australian National University · +2
    PDF ↗
  27. 2021
    Continual Learning with Dual RegularizationsXuejun Han, Yuhong GuoSpringer LNCS · Carleton University · Canadian Institute for Advanced Research
  28. 2021
    Explaining How Deep Neural Networks Forget by Deep VisualizationGiang V. Nguyen, Chen Shuan, Tae Joon Jun, Daeyoung KimSpringer LNCS · Korea Advanced Institute of Science and Technology · Ansan University
    PDF ↗
  29. 2021
    Improving the Quality Trade-Off for Neural Machine Translation Multi-Domain AdaptationEva Hasler, Tobias Domhan, Jonay Trénous … Felix HieberEMNLP · Amazon (Germany)
  30. 2021
    DRILL: Dynamic Representations for Imbalanced Lifelong LearningKyra Ahrens, Fares Abawi, Stefan WermterSpringer LNCS · Universität Hamburg
    PDF ↗
  31. 2021PDF ↗
  32. 2021
    Lifelong Knowledge-Enriched Social Event Representation LearningPrashanth Vijayaraghavan, Deb RoyEACL · IIT@MIT · Human Media
  33. 2021
    Lifelong Learning Augmented Short Text Stream Clustering MethodJipeng Qiang, Wanyin Xu, Yun Li … Yi ZhuIEEE Access · Yangzhou University
  34. 2021
    Object Recognition with Continual Open Set Domain Adaptation for Home RobotIkki Kishida, Hong Chen, Masaki Baba … Hideki NakayamaWACV · The University of Tokyo
  35. 2021
    Pseudo-Labeling for Class Incremental LearningAlexis Lechat, Stéphane Herbin, Frédéric JurieBMVC · Université Paris-Saclay · Office National d'Études et de Recherches Aérospatiales · +3
  36. 2021
    HCV: Hierarchy-Consistency Verification for Incremental Implicitly-Refined ClassificationKai Wang, Xialei Liu, Luis Herranz, Joost van de WeijerBMVC · Universitat Autònoma de Barcelona · Nankai University
    PDF ↗
  37. 2021
    Hyperparameter-free Continuous Learning for Domain Classification in Natural Language UnderstandingTing Hua, Yilin Shen, Changsheng Zhao … Hongxia JinNAACL · Samsung (United States) · Research!America (United States)
    PDF ↗
  38. 2021
    On robustness of generative representations against catastrophic forgettingWojciech Masarczyk, Kamil Rafał Deja, T. P. TrzcinskiSpringer CCIS · Warsaw University of Technology · Jagiellonian University
    PDF ↗
  39. 2021
    Continual Learning with Laplace Operator Based Node-Importance Dynamic Architecture Neural NetworkZhiyuan Li, Ming Meng, Yifan He, Yihao LiaoSpringer LNCS · Hangzhou Dianzi University
  40. 2021
    Incremental Learning for Animal Pose Estimation using RBF k-DPPGaurav Kumar Nayak, Het Shah, Anirban ChakrabortyBMVC · Indian Institute of Science Bangalore
    PDF ↗
  41. 2021
    Measuring Catastrophic Forgetting in Visual Question AnsweringClaudio Greco, Barbara Plank, Raquel Fernández, Raffaella BernardiSpringer LNCS · University of Trento · IT University of Copenhagen · +1
  42. 2021
    NASIL: Neural Network Architecture Searching for Incremental Learning in Image ClassificationXianya Fu, Wenrui Li, Qiurui Chen … Rui WangSpringer CCIS · Beihang University · State Key Joint Laboratory of Environment Simulation and Pollution Control
  43. 2021
  44. 2021
    Continual Learning of 3D Point Cloud GeneratorsMichał Sadowski, Karol J. Piczak, Przemysław Spurek, T. P. TrzcinskiSpringer LNCS · Jagiellonian University · Warsaw University of Technology
  45. 2021
    Principal Gradient Direction and Confidence Reservoir Sampling for Continual LearningZhiyi Chen, Tong LinSpringer LNCS · Georgia Institute of Technology · Peking University · +1
    PDF ↗
  46. 2021
    Lifelong Learning from Event-based DataVadym Gryshchuk, Cornelius Weber, Chu Kiong Loo, Stefan WermterESANN 2021 proceedings · Universität Hamburg · University of Malaya
    PDF ↗
  47. 2021
    Designing deep neural networks for continual learning in an open worldMartin MundtGoethe-Universität Frankfurt am Main
  48. 2021
    Lifelong Explainer for Lifelong LearnersXuelin Situ, Sameen Maruf, Ingrid Zukerman … Gholamreza HaffariEMNLP · Monash University · Commonwealth Scientific and Industrial Research Organisation · +2
  49. 2021
    Class-Incremental Learning via Dual AugmentationFei Zhu, Zhen Cheng, Xu-Yao Zhang, Cheng-Lin LiuNeurIPS
  50. 2021
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.