Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

532 papers of 6,984 · showing 401–450Sort Recent · Most cited
  1. 2021
    CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification TasksZixuan Ke, Bing Liu, Hu Xu, Lei ShuEMNLP · University of Illinois Chicago · Meta (Israel) · +1
    PDF ↗
  2. 2021
    Multilingual Machine Translation: Closing the Gap between Shared and Language-specific Encoder-DecodersCarlos Escolano, Marta R. Costa‐jussà, José A. R. Fonollosa, Mikel ArtetxeEACL · Universitat Politècnica de Catalunya · University of the Basque Country · +1
    PDF ↗
  3. 2021
    Learning Adaptive Embedding Considering Incremental ClassYang Yang, Zhen-Qiang Sun, Hengshu Zhu … Jian YangTKDE · Nanjing University of Science and Technology · Nanjing Normal University · +4
    PDF ↗
  4. 2021
    Towards Continual Learning for Multilingual Machine Translation via Vocabulary SubstitutionXavier García, Noah Constant, Ankur P. Parikh, Orhan FıratNAACL · Google (United States)
    PDF ↗
  5. 2021
    Continual Representation Learning for Biometric IdentificationBo Zhao, Shixiang Tang, Dapeng Chen … Rui ZhaoWACV · Group Sense (China) · University of Edinburgh · +1
    PDF ↗
  6. 2021
    L3DOC: Lifelong 3D Object ClassificationYuyang Liu, Yang Cong, Gan Sun … Hongsen LiuTIP · Shenyang Institute of Automation · Chinese Academy of Sciences · +1
    PDF ↗
  7. 2021
    Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot LearningXisen Jin, Bill Yuchen Lin, Mohammad Rostami, Xiang RenEMNLP · University of Southern California · Biomedical Research Institute of Southern California · +1
    PDF ↗
  8. 2021
    Prototype-based Incremental Few-Shot SegmentationFabio Cermelli, Massimiliano Mancini, Yongqin Xian … Barbara CaputoBMVC
    PDF ↗
  9. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  10. 2021
    Lifelong Event Detection with Knowledge TransferPengfei Yu, Heng Ji, Prem NatarajanEMNLP · University of Illinois Urbana-Champaign · Amazon (United States)
    PDF ↗
  11. 2021
    Continual Learning for Neural Machine TranslationYue Cao, Haoran Wei, Boxing Chen, Xiaojun WanNAACL · Peking University · Alibaba Group (United States)
  12. 2021
    Continual Learning at the Edge: Real-Time Training on Smartphone DevicesLorenzo Pellegrini, Vincenzo Lomonaco, Gabriele Graffieti, Davide MaltoniESANN 2021 proceedings · Azienda-Unita' Sanitaria Locale Di Cesena · University of Pisa · +1
    PDF ↗
  13. 2021
    Pruning-then-Expanding Model for Domain Adaptation of Neural Machine TranslationShuhao Gu, Yang Feng, Wanying XieNAACL · Chinese Academy of Sciences · Institute of Computing Technology · +2
    PDF ↗
  14. 2021
    Continual Learning for Grounded Instruction Generation by Observing Human Following BehaviorNoriyuki Kojima, Alane Suhr, Yoav ArtziTACL · Cornell University · Cornell Tech
    PDF ↗
  15. 2021
    Lifelong Learning of Hate Speech Classification on Social MediaJing Qian, Hong Wang, Mai ElSherief, Xifeng YanNAACL · Georgia Institute of Technology · University of California, Santa Barbara
    PDF ↗
  16. 2021
    Do not Forget to Attend to Uncertainty while Mitigating Catastrophic ForgettingVinod K Kurmi, Badri N. Patro, Venkatesh K. Subramanian, Vinay P. NamboodiriWACV · Indian Institute of Technology Kanpur · University of Bath
    PDF ↗
  17. 2021
    SPACE: Structured Compression and Sharing of Representational Space for Continual LearningGobinda Saha, Isha Garg, Aayush Ankit, Kaushik RoyIEEE Access · Purdue University West Lafayette
    PDF ↗
  18. 2021
    Preserving Cross-Linguality of Pre-trained Models via Continual LearningZihan Liu, Genta Indra Winata, Andrea Madotto, Pascale FungWorkshop on Representation Learning for NLP (RepL4NLP-2021) · Hong Kong University of Science and Technology
  19. 2021
    Overcoming Catastrophic Forgetting Using Sparse Coding and Meta LearningJulio Hurtado, Hans Löbel, Álvaro SotoIEEE Access · Pontificia Universidad Católica de Chile
  20. 2021
    Studying Catastrophic Forgetting in Neural Ranking ModelsJesús Lovón-Melgarejo, Laure Soulier, Karen Pinel-Sauvagnat, Lynda TamineSpringer LNCS · Université Toulouse III - Paul Sabatier · Institut de Recherche en Informatique de Toulouse · +4
    PDF ↗
  21. 2021
    Continual Learning with Echo State NetworksAndrea Cossu, Davide Bacciu, Antonio Carta … Vincenzo LomonacoESANN 2021 proceedings · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  22. 2021
    Total Recall: a Customized Continual Learning Method for Neural Semantic ParsersZhuang Li, Lizhen Qu, Gholamreza HaffariEMNLP · Monash University
    PDF ↗
  23. 2021
    Elastic weight consolidation for better bias inoculationJames Thorne, Andreas VlachosEACL · University of Cambridge
    PDF ↗
  24. 2021
    Mitigating Mode Collapse by Sidestepping Catastrophic ForgettingKarttikeya Mangalam, Rohin GargBMVC · University of California, Berkeley · Indian Institute of Technology Kanpur
    PDF ↗
  25. 2021
    Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation NetworksQingbin Liu, Pengfei Cao, Cao Liu … Jun ZhaoEMNLP · Chinese Academy of Sciences · Shandong Institute of Automation · +5
  26. 2021
    Few-Shot Class Incremental Learning with Generative Feature ReplayAbhilash Shankarampeta, Koichiro YamauchiICPR · Indian Institute of Technology Guwahati · Chubu University
  27. 2021
    Continual Learning with Differential PrivacyPradnya Desai, Phung Lai, NhatHai Phan, My T. ThaiSpringer CCIS · New Jersey Institute of Technology · University of Florida
    PDF ↗
  28. 2021
    Learning without Forgetting for 3D Point Cloud ObjectsTownim Faisal Chowdhury, Mahira Jalisha, Ali Cheraghian, Shafin RahmanSpringer LNCS · North South University · Australian National University · +2
    PDF ↗
  29. 2021
    Continual Learning with Dual RegularizationsXuejun Han, Yuhong GuoSpringer LNCS · Carleton University · Canadian Institute for Advanced Research
  30. 2021
    Explaining How Deep Neural Networks Forget by Deep VisualizationGiang V. Nguyen, Chen Shuan, Tae Joon Jun, Daeyoung KimSpringer LNCS · Korea Advanced Institute of Science and Technology · Ansan University
    PDF ↗
  31. 2021
    Improving the Quality Trade-Off for Neural Machine Translation Multi-Domain AdaptationEva Hasler, Tobias Domhan, Jonay Trénous … Felix HieberEMNLP · Amazon (Germany)
  32. 2021
    Sustainable Artificial Intelligence through Continual LearningAndrea Cossu, Marta Ziosi, Vincenzo LomonacoInternational Conference on AI for People: Towards Sustai… · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  33. 2021
    DRILL: Dynamic Representations for Imbalanced Lifelong LearningKyra Ahrens, Fares Abawi, Stefan WermterSpringer LNCS · Universität Hamburg
    PDF ↗
  34. 2021PDF ↗
  35. 2021
    Lifelong Knowledge-Enriched Social Event Representation LearningPrashanth Vijayaraghavan, Deb RoyEACL · IIT@MIT · Human Media
  36. 2021
    Class-incremental Learning with Rectified Feature-Graph PreservationCheng-Hsun Lei, Yi-Hsin Chen, Wen-Hsiao Peng, Wei-Chen ChiuSpringer LNCS · National Yang Ming Chiao Tung University
    PDF ↗
  37. 2021
    Lifelong Learning Augmented Short Text Stream Clustering MethodJipeng Qiang, Wanyin Xu, Yun Li … Yi ZhuIEEE Access · Yangzhou University
  38. 2021
    Object Recognition with Continual Open Set Domain Adaptation for Home RobotIkki Kishida, Hong Chen, Masaki Baba … Hideki NakayamaWACV · The University of Tokyo
  39. 2021
    Pseudo-Labeling for Class Incremental LearningAlexis Lechat, Stéphane Herbin, Frédéric JurieBMVC · Université Paris-Saclay · Office National d'Études et de Recherches Aérospatiales · +3
  40. 2021
    HCV: Hierarchy-Consistency Verification for Incremental Implicitly-Refined ClassificationKai Wang, Xialei Liu, Luis Herranz, Joost van de WeijerBMVC · Universitat Autònoma de Barcelona · Nankai University
    PDF ↗
  41. 2021
    Hyperparameter-free Continuous Learning for Domain Classification in Natural Language UnderstandingTing Hua, Yilin Shen, Changsheng Zhao … Hongxia JinNAACL · Samsung (United States) · Research!America (United States)
    PDF ↗
  42. 2021
    On robustness of generative representations against catastrophic forgettingWojciech Masarczyk, Kamil Rafał Deja, T. P. TrzcinskiSpringer CCIS · Warsaw University of Technology · Jagiellonian University
    PDF ↗
  43. 2021
    Continual Learning with Laplace Operator Based Node-Importance Dynamic Architecture Neural NetworkZhiyuan Li, Ming Meng, Yifan He, Yihao LiaoSpringer LNCS · Hangzhou Dianzi University
  44. 2021
    Homeostasis-Inspired Continual Learning: Learning to Control Structural RegularizationJoonyoung Kim, Hyowoon Seo, Wan Choi, Kyomin JungIEEE Access · Seoul National University · University of Oulu · +1
  45. 2021
    Incremental Learning for Animal Pose Estimation using RBF k-DPPGaurav Kumar Nayak, Het Shah, Anirban ChakrabortyBMVC · Indian Institute of Science Bangalore
    PDF ↗
  46. 2021
    Measuring Catastrophic Forgetting in Visual Question AnsweringClaudio Greco, Barbara Plank, Raquel Fernández, Raffaella BernardiSpringer LNCS · University of Trento · IT University of Copenhagen · +1
  47. 2021
    NASIL: Neural Network Architecture Searching for Incremental Learning in Image ClassificationXianya Fu, Wenrui Li, Qiurui Chen … Rui WangSpringer CCIS · Beihang University · State Key Joint Laboratory of Environment Simulation and Pollution Control
  48. 2021
    Self-supervised Continual Learning for Object Recognition in Image SequencesRuiqi Dai, Mathieu Lefort, Frédéric Armetta … Stefan DuffnerSpringer CCIS · Lyon 1 Université · Centre National de la Recherche Scientifique · +3
  49. 2021
  50. 2021
    Continual Learning of 3D Point Cloud GeneratorsMichał Sadowski, Karol J. Piczak, Przemysław Spurek, T. P. TrzcinskiSpringer LNCS · Jagiellonian University · Warsaw University of Technology
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.