Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

112 papers of 8,653 · showing 51–100Sort Recent · Most cited
  1. 2023
    FETCH: A Memory-Efficient Replay Approach for Continual Learning in Image ClassificationMarkus Weißflog, Peter Protzel, Peer NeubertSpringer LNCS · Chemnitz University of Technology · Koblenz University of Applied Sciences · +1
    PDF ↗
  2. 2023
    Machine Learning and Knowledge Discovery in Databases: Research Track: European Conference, ECML PKDD 2023, Turin, Italy, September 18–22, 2023, Proceedings, Part VDanai Koutra, Claudia Plant, Manuel Gomez-Rodriguez … Francesco BonchiSpringer LNCS · University of Michigan · University of Vienna · +2
    PDF ↗
  3. 2023
    Overcoming Catastrophic Forgetting for Fine-Tuning Pre-trained GANsZeren Zhang, Xingjian Li, Hong Tao … Chengzhong XuSpringer LNCS · Peking University · Baidu (China) · +2
  4. 2023
    POSTER: Advancing Federated Edge Computing with Continual Learning for Secure and Efficient PerformanceChunlu Chen, Kevin I‐Kai Wang, Peng Li, Kouichi SakuraiSpringer LNCS · Kyushu University · University of Auckland · +1
  5. 2023
    Dynamic Memory-Based Continual Learning with Generating and ScreeningSiying Tao, Jinyang Huang, Xiang Zhang … Yu GuSpringer LNCS · Hefei University of Technology · University of Science and Technology of China · +1
  6. 2023
    NeCa: Network Calibration for Class Incremental LearningZhenyao Zhang, Lijun ZhangSpringer LNCS · Nanjing University
  7. 2023
    Class-Incremental Learning with Multiscale Distillation for Weakly Supervised Temporal Action LocalizationTianquan Chen, Bairong Li, Yusheng Tao … Yuesheng ZhuSpringer LNCS · Peking University
  8. 2023
    Continual Vocabularies to Tackle the Catastrophic Forgetting Problem in Machine TranslationSalvador Carrión, Francisco CasacubertaSpringer LNCS · Universitat Politècnica de València
  9. 2022
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  10. 2022
    Practical Recommendations for Replay-based Continual Learning MethodsGabriele Merlin, Vincenzo Lomonaco, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  11. 2022
    Unsupervised Continual Learning Via Pseudo LabelsJiangpeng He, Fengqing ZhuSpringer LNCS · Purdue University West Lafayette
    PDF ↗
  12. 2022
    SPeCiaL: Self-Supervised Pretraining for Continual LearningLucas Caccia, Joëlle PineauSpringer LNCS · McGill University
    PDF ↗
  13. 2022
    Knowledge Lock: Overcoming Catastrophic Forgetting in Federated LearningGuoyizhe Wei, Xiu LiSpringer LNCS · University Town of Shenzhen · Tsinghua University
  14. 2022
    Reducing Catastrophic Forgetting in Neural Networks via Gaussian Mixture ApproximationHoang Phan, Anh Phan Tuan, Son Nguyen … Khoat ThanSpringer LNCS · VinUniversity · Hanoi University of Science and Technology
  15. 2022
    Auxiliary Local Variables for Improving Regularization/Prior Approach in Continual LearningLinh Ngo Van, Nam Le Hai, Hoang Pham, Khoat ThanSpringer LNCS · Hanoi University of Science and Technology
  16. 2022
    Adaptive Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  17. 2022
    Contrastive Supervised Distillation for Continual Representation LearningTommaso Barletti, Niccolò Biondi, Federico Pernici … Alberto Del BimboSpringer LNCS · University of Florence
    PDF ↗
  18. 2022
    Avalanche RL: a Continual Reinforcement Learning LibraryNicoló Lucchesi, Antonio Carta, Vincenzo Lomonaco, Davide BacciuSpringer LNCS · University of Pisa
    PDF ↗
  19. 2022
    Continual Learning of Long Topic Sequences in Neural Information Retrieval - abstractThomas Gerald, Laure SoulierSpringer LNCS · Centre National de la Recherche Scientifique · Sorbonne Université · +1
    PDF ↗
  20. 2022
    Adaptive Feature Generation for Online Continual Learning from Imbalanced DataYingchun Jian, Jinfeng Yi, Lijun ZhangSpringer LNCS · Nanjing University · Jingdong (China)
  21. 2022
    Adaptive Neural Networks for Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  22. 2022
    Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement LearningRobin Schiewer, Laurenz WiskottSpringer LNCS · Ruhr University Bochum
    PDF ↗
  23. 2022
    Evaluating Continual Learning Algorithms by Generating 3D Virtual EnvironmentsEnrico Meloni, Alessandro Betti, Lapo Faggi … Stefano MelacciSpringer LNCS · University of Siena · University of Florence
    PDF ↗
  24. 2022
    Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in TransformersPhilip Kenneweg, Alexander Schulz, Sarah Schröder, Barbara HammerSpringer LNCS · Bielefeld University
    PDF ↗
  25. 2022
    Computationally Efficient Rehearsal for Online Continual LearningCharalampos Davalas, Dimitrios Michail, Christos Diou … Konstantinos TserpesSpringer LNCS · Harokopio University of Athens
  26. 2022
    Gradient Regularization with Multivariate Distribution of Previous Knowledge for Continual LearningTaeheon Kim, Hyung-Jun Moon, Sung‐Bae ChoSpringer LNCS · Yonsei University
  27. 2022
    A Novel Continual Learning Approach for Competitive Neural NetworksEsteban J. Palomo, Juan Miguel Ortiz-de-Lazcano-Lobato, José David Fernández-Rodríguez … Rosa Maza-QuirogaSpringer LNCS · Instituto de Investigación Biomédica de Málaga · Universidad de Málaga
  28. 2022
    Catastrophic Forgetting in Continual Concept Bottleneck ModelsEmanuele Marconato, Gianpaolo Bontempo, Stefano Teso … Andrea PasseriniSpringer LNCS · University of Pisa · University of Trento · +1
  29. 2022
    Continual Learning with Neuron Activation ImportanceSohee Kim, Seungkyu LeeSpringer LNCS · Kyung Hee University
    PDF ↗
  30. 2022
    Modular-Relatedness for Continual LearningAmmar Shaker, Francesco Alesiani, Shujian YuSpringer LNCS · UiT The Arctic University of Norway
    PDF ↗
  31. 2022
    Transfer and Continual Supervised Learning for Robotic Grasping Through Grasping FeaturesLuca Monorchio, Marco Capotondi, Mario Corsanici … Francesco PujaSpringer LNCS · Sapienza University of Rome
  32. 2022
    Discriminative Distillation to Reduce Class Confusion in Continual LearningChanghong Zhong, Zhiying Cui, Wei‐Shi Zheng … Ruixuan WangSpringer LNCS · Sun Yat-sen University · Key Laboratory of Guangdong Province
    PDF ↗
  33. 2022
    Self-supervised Novelty Detection for Continual Learning: A Gradient-Based Approach Boosted by Binary ClassificationJingbo Sun, Li Yang, Jiaxin Zhang … Yu CaoSpringer LNCS · Arizona State University · Oak Ridge National Laboratory · +1
  34. 2022
    Partially Relaxed Masks for Knowledge Transfer Without Forgetting in Continual LearningTatsuya Konishi, Mori Kurokawa, Chihiro Ono … Bing LiuSpringer LNCS · KDDI Research (Japan) · University of Illinois Chicago
  35. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  36. 2021
    Studying Catastrophic Forgetting in Neural Ranking ModelsJesús Lovón-Melgarejo, Laure Soulier, Karen Pinel-Sauvagnat, Lynda TamineSpringer LNCS · Université Toulouse III - Paul Sabatier · Institut de Recherche en Informatique de Toulouse · +4
    PDF ↗
  37. 2021
    Learning without Forgetting for 3D Point Cloud ObjectsTownim Faisal Chowdhury, Mahira Jalisha, Ali Cheraghian, Shafin RahmanSpringer LNCS · North South University · Australian National University · +2
    PDF ↗
  38. 2021
    Continual Learning with Dual RegularizationsXuejun Han, Yuhong GuoSpringer LNCS · Carleton University · Canadian Institute for Advanced Research
  39. 2021
    Explaining How Deep Neural Networks Forget by Deep VisualizationGiang V. Nguyen, Chen Shuan, Tae Joon Jun, Daeyoung KimSpringer LNCS · Korea Advanced Institute of Science and Technology · Ansan University
    PDF ↗
  40. 2021
    DRILL: Dynamic Representations for Imbalanced Lifelong LearningKyra Ahrens, Fares Abawi, Stefan WermterSpringer LNCS · Universität Hamburg
    PDF ↗
  41. 2021
    Continual Learning with Laplace Operator Based Node-Importance Dynamic Architecture Neural NetworkZhiyuan Li, Ming Meng, Yifan He, Yihao LiaoSpringer LNCS · Hangzhou Dianzi University
  42. 2021
    Measuring Catastrophic Forgetting in Visual Question AnsweringClaudio Greco, Barbara Plank, Raquel Fernández, Raffaella BernardiSpringer LNCS · University of Trento · IT University of Copenhagen · +1
  43. 2021
    Continual Learning of 3D Point Cloud GeneratorsMichał Sadowski, Karol J. Piczak, Przemysław Spurek, T. P. TrzcinskiSpringer LNCS · Jagiellonian University · Warsaw University of Technology
  44. 2021
    Principal Gradient Direction and Confidence Reservoir Sampling for Continual LearningZhiyi Chen, Tong LinSpringer LNCS · Georgia Institute of Technology · Peking University · +1
    PDF ↗
  45. 2020
    Continual Learning of Image Translation Networks Using Task-Dependent Weight Selection MasksMatsumoto Asato, ‪Keiji Yanai‬Springer LNCS · University of Electro-Communications
  46. 2020
    An Incremental Learning Network Model Based on Random Sample Distribution FittingWencong Wang, Lan Huang, Hao Liu … Kangping WangSpringer LNCS · Jilin University · Jilin Province Science and Technology Department
  47. 2019
    Revisiting Distillation and Incremental Classifier LearningKhurram Javed, Faisal ShafaitSpringer LNCS · National University of Sciences and Technology
    PDF ↗
  48. 2019
    Adding New Tasks to a Single Network with Weight Trasformations using Binary MasksMassimiliano Mancini, Elisa Ricci, Barbara Caputo, Samuel Rota BulòSpringer LNCS · Fondazione Bruno Kessler · Sapienza University of Rome · +2
    PDF ↗
  49. 2019
    Overcoming Catastrophic Interference with Bayesian Learning and Stochastic Langevin DynamicsMikhail Leontev, Alexander Mikheev, Kirill Sviatov, Sergey SukhovSpringer LNCS · Ulyanovsk State University · Kotelnikov Institute of Radioengineering and Electronics of the Russian Academy of Sciences · +1
  50. 2019
    Lifelong Learning Starting From ZeroClaes Strannegård, Herman Carlström, Niklas Engsner … Morteza Haghir ChehreghaniSpringer LNCS · Chalmers University of Technology
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.