Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

115 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2022
    UNIKD: UNcertainty-Filtered Incremental Knowledge Distillation for Neural Implicit RepresentationMengqi Guo, Li Chen, Hanlin Chen, Gim Hee LeeSpringer LNCS · National University of Singapore
    PDF ↗
  2. 2022
    The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot TransferPavel Efimov, Leonid Boytsov, Elena Arslanova, Pavel BraslavskiSpringer LNCS · ITMO University · Robert Bosch (United States) · +2
    PDF ↗
  3. 2021
    Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse NetworksGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiySpringer LNCS · Eindhoven University of Technology · University of Twente
    PDF ↗
  4. 2021PDF ↗
  5. 2021
    Generalising via Meta-Examples for Continual Learning in the WildAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniSpringer LNCS · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  6. 2020
    Overcoming Catastrophic Forgetting via Direction-Constrained OptimizationYunfei Teng, Anna Choromanska, Murray Campbell … Lior HoreshSpringer LNCS · New York University
    PDF ↗
  7. 2022
    Machine Learning and Knowledge Discovery in Databases: Research Track: European Conference, ECML PKDD 2023, Turin, Italy, September 18–22, 2023, Proceedings, Part VDanai Koutra, Claudia Plant, Manuel Gomez-Rodriguez … Francesco BonchiSpringer LNCS · University of Michigan · University of Vienna · +2
    PDF ↗
  8. 2021
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  9. 2022
    Understanding Collapse in Non-contrastive Siamese Representation LearningAlexander C. Li, Alexei A. Efros, Deepak PathakSpringer LNCS · Carnegie Mellon University · University of California, Berkeley
    PDF ↗
  10. 2022
    Helpful or Harmful: Inter-task Association in Continual LearningHyundong Jin, Eunwoo KimSpringer LNCS · Chung-Ang University
  11. 2022
    Practical Recommendations for Replay-based Continual Learning MethodsGabriele Merlin, Vincenzo Lomonaco, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  12. 2021
    Unsupervised Continual Learning Via Pseudo LabelsJiangpeng He, Fengqing ZhuSpringer LNCS · Purdue University West Lafayette
    PDF ↗
  13. 2021
    Incremental Learning for Multi-organ Segmentation with Partially Labeled DatasetsPengbo Liu, Xia Wang, Mengsi Fan … Shuchang ZhouSpringer LNCS · University of Science and Technology of China · Chinese Academy of Sciences · +4
    PDF ↗
  14. 2021
    Unsupervised Continual Learning via Self-Adaptive Deep Clustering ApproachMahardhika Pratama, Andri Ashfahani, Edwin LughoferSpringer LNCS · University of South Australia · Nanyang Technological University
    PDF ↗
  15. 2021
    SPeCiaL: Self-Supervised Pretraining for Continual LearningLucas Caccia, Joëlle PineauSpringer LNCS · McGill University
    PDF ↗
  16. 2022
    Contrastive Supervised Distillation for Continual Representation LearningTommaso Barletti, Niccolò Biondi, Federico Pernici … Alberto Del BimboSpringer LNCS · University of Florence
    PDF ↗
  17. 2022
    Avalanche RL: a Continual Reinforcement Learning LibraryNicoló Lucchesi, Antonio Carta, Vincenzo Lomonaco, Davide BacciuSpringer LNCS · University of Pisa
    PDF ↗
  18. 2022
    Bridging Images and Videos: A Simple Learning Framework for Large Vocabulary Video Object DetectionSanghyun Woo, Kwanyong Park, Seoung Wug Oh … Joon‐Young LeeSpringer LNCS · Korea Advanced Institute of Science and Technology · Adobe Systems (United States)
    PDF ↗
  19. 2022
    Continual Learning of Long Topic Sequences in Neural Information Retrieval - abstractThomas Gerald, Laure SoulierSpringer LNCS · Centre National de la Recherche Scientifique · Sorbonne Université · +1
    PDF ↗
  20. 2021
    Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement LearningRobin Schiewer, Laurenz WiskottSpringer LNCS · Ruhr University Bochum
    PDF ↗
  21. 2021
    Evaluating Continual Learning Algorithms by Generating 3D Virtual EnvironmentsEnrico Meloni, Alessandro Betti, Lapo Faggi … Stefano MelacciSpringer LNCS · University of Siena · University of Florence
    PDF ↗
  22. 2021
    Continual Learning with Neuron Activation ImportanceSohee Kim, Seungkyu LeeSpringer LNCS · Kyung Hee University
    PDF ↗
  23. 2020
    Modular-Relatedness for Continual LearningAmmar Shaker, Francesco Alesiani, Shujian YuSpringer LNCS · UiT The Arctic University of Norway
    PDF ↗
  24. 2021
    Transfer and Continual Supervised Learning for Robotic Grasping Through Grasping FeaturesLuca Monorchio, Marco Capotondi, Mario Corsanici … Francesco PujaSpringer LNCS · Sapienza University of Rome
  25. 2021
    Discriminative Distillation to Reduce Class Confusion in Continual LearningChanghong Zhong, Zhiying Cui, Wei‐Shi Zheng … Ruixuan WangSpringer LNCS · Sun Yat-sen University · Key Laboratory of Guangdong Province
    PDF ↗
  26. 2021
    Self-supervised Novelty Detection for Continual Learning: A Gradient-Based Approach Boosted by Binary ClassificationJingbo Sun, Li Yang, Jiaxin Zhang … Yu CaoSpringer LNCS · Arizona State University · Oak Ridge National Laboratory · +1
  27. 2021
    The Role of Bio-Inspired Modularity in General LearningRachel A. StClair, William Edward Hahn, Elan BarenholtzSpringer LNCS · Florida Atlantic University
    PDF ↗
  28. 2021
    Continual Learning with Knowledge Transfer for Sentiment ClassificationZixuan Ke, Bing Liu, Hao Wang, Lei ShuSpringer LNCS · University of Illinois Chicago · Southwest Jiaotong University
    PDF ↗
  29. 2021
    Learning Visual Models Using a Knowledge Graph as a TrainerSebastian Monka, Lavdim Halilaj, Stefan Schmid, Achim RettingerSpringer LNCS · Robert Bosch (Taiwan) · Robert Bosch (Germany) · +1
    PDF ↗
  30. 2021
    Studying Catastrophic Forgetting in Neural Ranking ModelsJesús Lovón-Melgarejo, Laure Soulier, Karen Pinel-Sauvagnat, Lynda TamineSpringer LNCS · Université Toulouse III - Paul Sabatier · Institut de Recherche en Informatique de Toulouse · +4
    PDF ↗
  31. 2022PDF ↗
  32. 2021
    Learning without Forgetting for 3D Point Cloud ObjectsTownim Faisal Chowdhury, Mahira Jalisha, Ali Cheraghian, Shafin RahmanSpringer LNCS · North South University · Australian National University · +2
    PDF ↗
  33. 2021
    Continual Learning with Dual RegularizationsXuejun Han, Yuhong GuoSpringer LNCS · Carleton University · Canadian Institute for Advanced Research
  34. 2020
    Explaining How Deep Neural Networks Forget by Deep VisualizationGiang V. Nguyen, Chen Shuan, Tae Joon Jun, Daeyoung KimSpringer LNCS · Korea Advanced Institute of Science and Technology · Ansan University
    PDF ↗
  35. 2021
    Analysis of hidden feedback loops in continuous machine learning systemsAnton KhritankovSpringer LNCS · Moscow Institute of Physics and Technology
    PDF ↗
  36. 2021
    Contrastive Representations for Continual Learning of Fine-Grained Histology ImagesTapabrata Chakraborti, Fergus Gleeson, Jens RittscherSpringer LNCS · University of Oxford
  37. 2021
    DocReader: Bounding-Box Free Training of a Document Information Extraction ModelShachar Klaiman, Marius LehneSpringer LNCS · Systems, Applications & Products in Data Processing (Germany)
    PDF ↗
  38. 2021
    DRILL: Dynamic Representations for Imbalanced Lifelong LearningKyra Ahrens, Fares Abawi, Stefan WermterSpringer LNCS · Universität Hamburg
    PDF ↗
  39. 2020
    Class-incremental Learning with Rectified Feature-Graph PreservationCheng-Hsun Lei, Yi-Hsin Chen, Wen-Hsiao Peng, Wei-Chen ChiuSpringer LNCS · National Yang Ming Chiao Tung University
    PDF ↗
  40. 2022
    Bilevel Online Deep Learning in Non-stationary EnvironmentYa-nan Han, Jian–wei Liu, Bing-biao Xiao … Xiong-lin LuoSpringer LNCS · China University of Petroleum, Beijing
    PDF ↗
  41. 2021
    Continual Learning for Object Classification: A Modular ApproachDaniel Z. Turner, Pedro J. S. Cardoso, João M. F. RodriguesSpringer LNCS · University of Algarve
  42. 2021
    Continual Learning for Multi-camera RelocalisationAldrich A. Cabrera-Ponce, Manuel Martín-Ortíz, José Martínez-CarranzaSpringer LNCS · Benemérita Universidad Autónoma de Puebla · University of Bristol · +1
  43. 2021
    Generalised Controller Design Using Continual LearningDiana Benavides‐Prado, Chathura Wanigasekara, Akshya SwainSpringer LNCS · Auckland University of Technology · University of Auckland
  44. 2021
    Continual Learning with Laplace Operator Based Node-Importance Dynamic Architecture Neural NetworkZhiyuan Li, Ming Meng, Yifan He, Yihao LiaoSpringer LNCS · Hangzhou Dianzi University
  45. 2019
    Measuring Catastrophic Forgetting in Visual Question AnsweringClaudio Greco, Barbara Plank, Raquel Fernández, Raffaella BernardiSpringer LNCS · University of Trento · IT University of Copenhagen · +1
  46. 2021
    Continual Learning of 3D Point Cloud GeneratorsMichał Sadowski, Karol J. Piczak, Przemysław Spurek, T. P. TrzcinskiSpringer LNCS · Jagiellonian University · Warsaw University of Technology
  47. 2021
    Principal Gradient Direction and Confidence Reservoir Sampling for Continual LearningZhiyi Chen, Tong LinSpringer LNCS · Georgia Institute of Technology · Peking University · +1
    PDF ↗
  48. 2021
  49. 2021
    Dynamic Mitigation of Catastrophic Forgetting Using the Sampling NetworkDae Yong Hong, Yan Li, Byeong‐Seok ShinSpringer LNCS · Inha University
  50. 2020
    An Empirical Study of Incremental Learning in Neural Network with Noisy Training SetShovik Ganguly, Atrayee Chatterjee, Debasmita Bhoumik, Ritajit MajumdarSpringer LNCS · University of Calcutta · Indian Statistical Institute
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.