Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

28 papers of 8,653Sort Recent · Most cited
  1. 2021
    Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse NetworksGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiySpringer LNCS · Eindhoven University of Technology · University of Twente
    PDF ↗
  2. 2021
    Generalising via Meta-Examples for Continual Learning in the WildAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniSpringer LNCS · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  3. 2021
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  4. 2021
    Unsupervised Continual Learning Via Pseudo LabelsJiangpeng He, Fengqing ZhuSpringer LNCS · Purdue University West Lafayette
    PDF ↗
  5. 2021
    Unsupervised Continual Learning via Self-Adaptive Deep Clustering ApproachMahardhika Pratama, Andri Ashfahani, Edwin LughoferSpringer LNCS · University of South Australia · Nanyang Technological University
    PDF ↗
  6. 2021
    SPeCiaL: Self-Supervised Pretraining for Continual LearningLucas Caccia, Joëlle PineauSpringer LNCS · McGill University
    PDF ↗
  7. 2021
    Coarse-To-Fine Incremental Few-Shot LearningXiang Xiang, Yuwen Tan, Qian Wan … Gregory D. HagerSpringer LNCS · Huazhong University of Science and Technology · Johns Hopkins University
    PDF ↗
  8. 2021
    Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement LearningRobin Schiewer, Laurenz WiskottSpringer LNCS · Ruhr University Bochum
    PDF ↗
  9. 2021
    Evaluating Continual Learning Algorithms by Generating 3D Virtual EnvironmentsEnrico Meloni, Alessandro Betti, Lapo Faggi … Stefano MelacciSpringer LNCS · University of Siena · University of Florence
    PDF ↗
  10. 2021
    Continual Learning with Neuron Activation ImportanceSohee Kim, Seungkyu LeeSpringer LNCS · Kyung Hee University
    PDF ↗
  11. 2021
    Transfer and Continual Supervised Learning for Robotic Grasping Through Grasping FeaturesLuca Monorchio, Marco Capotondi, Mario Corsanici … Francesco PujaSpringer LNCS · Sapienza University of Rome
  12. 2021
    Discriminative Distillation to Reduce Class Confusion in Continual LearningChanghong Zhong, Zhiying Cui, Wei‐Shi Zheng … Ruixuan WangSpringer LNCS · Sun Yat-sen University · Key Laboratory of Guangdong Province
    PDF ↗
  13. 2021
    Self-supervised Novelty Detection for Continual Learning: A Gradient-Based Approach Boosted by Binary ClassificationJingbo Sun, Li Yang, Jiaxin Zhang … Yu CaoSpringer LNCS · Arizona State University · Oak Ridge National Laboratory · +1
  14. 2021
    On Regret Bounds for Continual Single-Index LearningThe Tien MaiSpringer LNCS · Norwegian University of Science and Technology
    PDF ↗
  15. 2021
    The Role of Bio-Inspired Modularity in General LearningRachel A. StClair, William Edward Hahn, Elan BarenholtzSpringer LNCS · Florida Atlantic University
    PDF ↗
  16. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  17. 2021
    Studying Catastrophic Forgetting in Neural Ranking ModelsJesús Lovón-Melgarejo, Laure Soulier, Karen Pinel-Sauvagnat, Lynda TamineSpringer LNCS · Université Toulouse III - Paul Sabatier · Institut de Recherche en Informatique de Toulouse · +4
    PDF ↗
  18. 2021
    Learning without Forgetting for 3D Point Cloud ObjectsTownim Faisal Chowdhury, Mahira Jalisha, Ali Cheraghian, Shafin RahmanSpringer LNCS · North South University · Australian National University · +2
    PDF ↗
  19. 2021
    Continual Learning with Dual RegularizationsXuejun Han, Yuhong GuoSpringer LNCS · Carleton University · Canadian Institute for Advanced Research
  20. 2021
    DRILL: Dynamic Representations for Imbalanced Lifelong LearningKyra Ahrens, Fares Abawi, Stefan WermterSpringer LNCS · Universität Hamburg
    PDF ↗
  21. 2021
    Continual Learning for Object Classification: A Modular ApproachDaniel Z. Turner, Pedro J. S. Cardoso, João M. F. RodriguesSpringer LNCS · University of Algarve
  22. 2021
    Continual Learning for Multi-camera RelocalisationAldrich A. Cabrera-Ponce, Manuel Martín-Ortíz, José Martínez-CarranzaSpringer LNCS · Benemérita Universidad Autónoma de Puebla · University of Bristol · +1
  23. 2021
    Continual Learning with Laplace Operator Based Node-Importance Dynamic Architecture Neural NetworkZhiyuan Li, Ming Meng, Yifan He, Yihao LiaoSpringer LNCS · Hangzhou Dianzi University
  24. 2021
    Continual Learning of 3D Point Cloud GeneratorsMichał Sadowski, Karol J. Piczak, Przemysław Spurek, T. P. TrzcinskiSpringer LNCS · Jagiellonian University · Warsaw University of Technology
  25. 2021
    Principal Gradient Direction and Confidence Reservoir Sampling for Continual LearningZhiyi Chen, Tong LinSpringer LNCS · Georgia Institute of Technology · Peking University · +1
    PDF ↗
  26. 2021
  27. 2021
    Dynamic Mitigation of Catastrophic Forgetting Using the Sampling NetworkDae Yong Hong, Yan Li, Byeong‐Seok ShinSpringer LNCS · Inha University
  28. 2021
    Piggyback GAN: Efficient Lifelong Learning for Image Conditioned GenerationMengyao Zhai, Lei Chen, Jiawei He … Greg MoriSpringer LNCS · Simon Fraser University · Collège Boréal
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.