Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

33 papers of 11,817Sort Recent · Most cited
  1. 2021
    Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse NetworksGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiySpringer LNCS · Eindhoven University of Technology · University of Twente
    PDF ↗
  2. 2021PDF ↗
  3. 2021
    Generalising via Meta-Examples for Continual Learning in the WildAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniSpringer LNCS · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  4. 2021
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  5. 2021
    Unsupervised Continual Learning Via Pseudo LabelsJiangpeng He, Fengqing ZhuSpringer LNCS · Purdue University West Lafayette
    PDF ↗
  6. 2021
    Incremental Learning for Multi-organ Segmentation with Partially Labeled DatasetsPengbo Liu, Xia Wang, Mengsi Fan … Shuchang ZhouSpringer LNCS · University of Science and Technology of China · Chinese Academy of Sciences · +4
    PDF ↗
  7. 2021
    Unsupervised Continual Learning via Self-Adaptive Deep Clustering ApproachMahardhika Pratama, Andri Ashfahani, Edwin LughoferSpringer LNCS · University of South Australia · Nanyang Technological University
    PDF ↗
  8. 2021
    SPeCiaL: Self-Supervised Pretraining for Continual LearningLucas Caccia, Joëlle PineauSpringer LNCS · McGill University
    PDF ↗
  9. 2021
    Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement LearningRobin Schiewer, Laurenz WiskottSpringer LNCS · Ruhr University Bochum
    PDF ↗
  10. 2021
    Evaluating Continual Learning Algorithms by Generating 3D Virtual EnvironmentsEnrico Meloni, Alessandro Betti, Lapo Faggi … Stefano MelacciSpringer LNCS · University of Siena · University of Florence
    PDF ↗
  11. 2021
    Continual Learning with Neuron Activation ImportanceSohee Kim, Seungkyu LeeSpringer LNCS · Kyung Hee University
    PDF ↗
  12. 2021
    Transfer and Continual Supervised Learning for Robotic Grasping Through Grasping FeaturesLuca Monorchio, Marco Capotondi, Mario Corsanici … Francesco PujaSpringer LNCS · Sapienza University of Rome
  13. 2021
    Discriminative Distillation to Reduce Class Confusion in Continual LearningChanghong Zhong, Zhiying Cui, Wei‐Shi Zheng … Ruixuan WangSpringer LNCS · Sun Yat-sen University · Key Laboratory of Guangdong Province
    PDF ↗
  14. 2021
    Self-supervised Novelty Detection for Continual Learning: A Gradient-Based Approach Boosted by Binary ClassificationJingbo Sun, Li Yang, Jiaxin Zhang … Yu CaoSpringer LNCS · Arizona State University · Oak Ridge National Laboratory · +1
  15. 2021
    The Role of Bio-Inspired Modularity in General LearningRachel A. StClair, William Edward Hahn, Elan BarenholtzSpringer LNCS · Florida Atlantic University
    PDF ↗
  16. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  17. 2021
    Learning Visual Models Using a Knowledge Graph as a TrainerSebastian Monka, Lavdim Halilaj, Stefan Schmid, Achim RettingerSpringer LNCS · Robert Bosch (Taiwan) · Robert Bosch (Germany) · +1
    PDF ↗
  18. 2021
    Studying Catastrophic Forgetting in Neural Ranking ModelsJesús Lovón-Melgarejo, Laure Soulier, Karen Pinel-Sauvagnat, Lynda TamineSpringer LNCS · Université Toulouse III - Paul Sabatier · Institut de Recherche en Informatique de Toulouse · +4
    PDF ↗
  19. 2021
    Learning without Forgetting for 3D Point Cloud ObjectsTownim Faisal Chowdhury, Mahira Jalisha, Ali Cheraghian, Shafin RahmanSpringer LNCS · North South University · Australian National University · +2
    PDF ↗
  20. 2021
    Continual Learning with Dual RegularizationsXuejun Han, Yuhong GuoSpringer LNCS · Carleton University · Canadian Institute for Advanced Research
  21. 2021
    Analysis of hidden feedback loops in continuous machine learning systemsAnton KhritankovSpringer LNCS · Moscow Institute of Physics and Technology
    PDF ↗
  22. 2021
    Contrastive Representations for Continual Learning of Fine-Grained Histology ImagesTapabrata Chakraborti, Fergus Gleeson, Jens RittscherSpringer LNCS · University of Oxford
  23. 2021
    DocReader: Bounding-Box Free Training of a Document Information Extraction ModelShachar Klaiman, Marius LehneSpringer LNCS · Systems, Applications & Products in Data Processing (Germany)
    PDF ↗
  24. 2021
    DRILL: Dynamic Representations for Imbalanced Lifelong LearningKyra Ahrens, Fares Abawi, Stefan WermterSpringer LNCS · Universität Hamburg
    PDF ↗
  25. 2021
    Continual Learning for Object Classification: A Modular ApproachDaniel Z. Turner, Pedro J. S. Cardoso, João M. F. RodriguesSpringer LNCS · University of Algarve
  26. 2021
    Continual Learning for Multi-camera RelocalisationAldrich A. Cabrera-Ponce, Manuel Martín-Ortíz, José Martínez-CarranzaSpringer LNCS · Benemérita Universidad Autónoma de Puebla · University of Bristol · +1
  27. 2021
    Generalised Controller Design Using Continual LearningDiana Benavides‐Prado, Chathura Wanigasekara, Akshya SwainSpringer LNCS · Auckland University of Technology · University of Auckland
  28. 2021
    Continual Learning with Laplace Operator Based Node-Importance Dynamic Architecture Neural NetworkZhiyuan Li, Ming Meng, Yifan He, Yihao LiaoSpringer LNCS · Hangzhou Dianzi University
  29. 2021
    Continual Learning of 3D Point Cloud GeneratorsMichał Sadowski, Karol J. Piczak, Przemysław Spurek, T. P. TrzcinskiSpringer LNCS · Jagiellonian University · Warsaw University of Technology
  30. 2021
    Principal Gradient Direction and Confidence Reservoir Sampling for Continual LearningZhiyi Chen, Tong LinSpringer LNCS · Georgia Institute of Technology · Peking University · +1
    PDF ↗
  31. 2021
  32. 2021
    Dynamic Mitigation of Catastrophic Forgetting Using the Sampling NetworkDae Yong Hong, Yan Li, Byeong‐Seok ShinSpringer LNCS · Inha University
  33. 2021
    Piggyback GAN: Efficient Lifelong Learning for Image Conditioned GenerationMengyao Zhai, Lei Chen, Jiawei He … Greg MoriSpringer LNCS · Simon Fraser University · Collège Boréal
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.