Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

32 papers of 8,653Sort Recent · Most cited
  1. 2022
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  2. 2022
    Practical Recommendations for Replay-based Continual Learning MethodsGabriele Merlin, Vincenzo Lomonaco, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  3. 2022
    Unsupervised Continual Learning Via Pseudo LabelsJiangpeng He, Fengqing ZhuSpringer LNCS · Purdue University West Lafayette
    PDF ↗
  4. 2022
    Unsupervised Continual Learning via Self-Adaptive Deep Clustering ApproachMahardhika Pratama, Andri Ashfahani, Edwin LughoferSpringer LNCS · University of South Australia · Nanyang Technological University
    PDF ↗
  5. 2022
    SPeCiaL: Self-Supervised Pretraining for Continual LearningLucas Caccia, Joëlle PineauSpringer LNCS · McGill University
    PDF ↗
  6. 2022
    Knowledge Lock: Overcoming Catastrophic Forgetting in Federated LearningGuoyizhe Wei, Xiu LiSpringer LNCS · University Town of Shenzhen · Tsinghua University
  7. 2022
    Reducing Catastrophic Forgetting in Neural Networks via Gaussian Mixture ApproximationHoang Phan, Anh Phan Tuan, Son Nguyen … Khoat ThanSpringer LNCS · VinUniversity · Hanoi University of Science and Technology
  8. 2022
    Auxiliary Local Variables for Improving Regularization/Prior Approach in Continual LearningLinh Ngo Van, Nam Le Hai, Hoang Pham, Khoat ThanSpringer LNCS · Hanoi University of Science and Technology
  9. 2022
    Adaptive Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  10. 2022
    Contrastive Supervised Distillation for Continual Representation LearningTommaso Barletti, Niccolò Biondi, Federico Pernici … Alberto Del BimboSpringer LNCS · University of Florence
    PDF ↗
  11. 2022
    Avalanche RL: a Continual Reinforcement Learning LibraryNicoló Lucchesi, Antonio Carta, Vincenzo Lomonaco, Davide BacciuSpringer LNCS · University of Pisa
    PDF ↗
  12. 2022
    Continual Learning of Long Topic Sequences in Neural Information Retrieval - abstractThomas Gerald, Laure SoulierSpringer LNCS · Centre National de la Recherche Scientifique · Sorbonne Université · +1
    PDF ↗
  13. 2022
    Adaptive Feature Generation for Online Continual Learning from Imbalanced DataYingchun Jian, Jinfeng Yi, Lijun ZhangSpringer LNCS · Nanjing University · Jingdong (China)
  14. 2022
    Adaptive Neural Networks for Online Domain Incremental Continual LearningNuwan Gunasekara, Heitor Murilo Gomes, Albert Bifet, Bernhard PfahringerSpringer LNCS · University of Waikato
    PDF ↗
  15. 2022
    Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement LearningRobin Schiewer, Laurenz WiskottSpringer LNCS · Ruhr University Bochum
    PDF ↗
  16. 2022
    Evaluating Continual Learning Algorithms by Generating 3D Virtual EnvironmentsEnrico Meloni, Alessandro Betti, Lapo Faggi … Stefano MelacciSpringer LNCS · University of Siena · University of Florence
    PDF ↗
  17. 2022
    Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in TransformersPhilip Kenneweg, Alexander Schulz, Sarah Schröder, Barbara HammerSpringer LNCS · Bielefeld University
    PDF ↗
  18. 2022
    Computationally Efficient Rehearsal for Online Continual LearningCharalampos Davalas, Dimitrios Michail, Christos Diou … Konstantinos TserpesSpringer LNCS · Harokopio University of Athens
  19. 2022
    Gradient Regularization with Multivariate Distribution of Previous Knowledge for Continual LearningTaeheon Kim, Hyung-Jun Moon, Sung‐Bae ChoSpringer LNCS · Yonsei University
  20. 2022
    A Novel Continual Learning Approach for Competitive Neural NetworksEsteban J. Palomo, Juan Miguel Ortiz-de-Lazcano-Lobato, José David Fernández-Rodríguez … Rosa Maza-QuirogaSpringer LNCS · Instituto de Investigación Biomédica de Málaga · Universidad de Málaga
  21. 2022
    Catastrophic Forgetting in Continual Concept Bottleneck ModelsEmanuele Marconato, Gianpaolo Bontempo, Stefano Teso … Andrea PasseriniSpringer LNCS · University of Pisa · University of Trento · +1
  22. 2022
    Continual Learning with Neuron Activation ImportanceSohee Kim, Seungkyu LeeSpringer LNCS · Kyung Hee University
    PDF ↗
  23. 2022
    Modular-Relatedness for Continual LearningAmmar Shaker, Francesco Alesiani, Shujian YuSpringer LNCS · UiT The Arctic University of Norway
    PDF ↗
  24. 2022
    Real Time Data Augmentation Using Fractional Linear Transformations in Continual LearningArijit PatraSpringer LNCS · Biopharma Technology (United Kingdom)
  25. 2022
    Transfer and Continual Supervised Learning for Robotic Grasping Through Grasping FeaturesLuca Monorchio, Marco Capotondi, Mario Corsanici … Francesco PujaSpringer LNCS · Sapienza University of Rome
  26. 2022
    Discriminative Distillation to Reduce Class Confusion in Continual LearningChanghong Zhong, Zhiying Cui, Wei‐Shi Zheng … Ruixuan WangSpringer LNCS · Sun Yat-sen University · Key Laboratory of Guangdong Province
    PDF ↗
  27. 2022
    Self-supervised Novelty Detection for Continual Learning: A Gradient-Based Approach Boosted by Binary ClassificationJingbo Sun, Li Yang, Jiaxin Zhang … Yu CaoSpringer LNCS · Arizona State University · Oak Ridge National Laboratory · +1
  28. 2022
    Continual Learning Based on Knowledge Distillation and Representation LearningXiuyan Chen, Jian–wei Liu, Wentao LiSpringer LNCS · China University of Petroleum, Beijing
  29. 2022
    Continual Learning by Task-Wise Shared Hidden Representation AlignmentXu-hui Zhan, Jian–wei Liu, Ya-nan HanSpringer LNCS · China University of Petroleum, Beijing
  30. 2022
    On Regret Bounds for Continual Single-Index LearningThe Tien MaiSpringer LNCS · Norwegian University of Science and Technology
    PDF ↗
  31. 2022
    Partially Relaxed Masks for Knowledge Transfer Without Forgetting in Continual LearningTatsuya Konishi, Mori Kurokawa, Chihiro Ono … Bing LiuSpringer LNCS · KDDI Research (Japan) · University of Illinois Chicago
  32. 2022
    The Role of Bio-Inspired Modularity in General LearningRachel A. StClair, William Edward Hahn, Elan BarenholtzSpringer LNCS · Florida Atlantic University
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.