Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

115 papers of 11,817 · showing 51–100Sort Recent · Most cited
  1. 2020
    GDumb: A Simple Approach that Questions Our Progress in Continual LearningAmeya Prabhu, Philip H. S. Torr, Puneet K. DokaniaSpringer LNCS · University of Oxford
  2. 2019
    REMIND Your Neural Network to Prevent Catastrophic ForgettingTyler L. Hayes, Kushal Kafle, Robik Shrestha … Christopher KananSpringer LNCS · Rochester Institute of Technology · Adobe Systems (United States) · +2
    PDF ↗
  3. 2020
    Adversarial Continual LearningSayna Ebrahimi, Franziska Meier, Roberto Calandra … Marcus RohrbachSpringer LNCS · Berkeley College · Meta (United States) · +2
    PDF ↗
  4. 2020
    Memory-Efficient Incremental Learning Through Feature AdaptationAhmet İşcen, Jeffrey Zhang, Svetlana Lazebnik, Cordelia SchmidSpringer LNCS · University of Illinois Urbana-Champaign
    PDF ↗
  5. 2020
    Topology-Preserving Class-Incremental LearningXiaoyu Tao, Xinyuan Chang, Xiaopeng Hong … Yihong GongSpringer LNCS · Xi'an Jiaotong University · Peng Cheng Laboratory
  6. 2020
    Imbalanced Continual Learning with Partitioning Reservoir SamplingChris Dongjoo Kim, Jinseo Jeong, Gunhee KimSpringer LNCS · Seoul National University
    PDF ↗
  7. 2020
    More Classifiers, Less Forgetting: A Generic Multi-classifier Paradigm for Incremental LearningYu Liu, Sarah Parisot, Greg Slabaugh … Tinne TuytelaarsSpringer LNCS · KU Leuven · Huawei Technologies (China) · +1
  8. 2020
    Reparameterizing Convolutions for Incremental Multi-Task Learning without Task InterferenceMenelaos Kanakis, David Brüggemann, Suman Saha … Luc Van GoolSpringer LNCS · ETH Zurich · KU Leuven
    PDF ↗
  9. 2020
    Learning latent representations across multiple data domains using Lifelong VAEGANFei Ye, Adrian G. BorşSpringer LNCS · University of York
    PDF ↗
  10. 2020
    Online Continual Learning under Extreme Memory ConstraintsEnrico Fini, Stéphane Lathuilière, Enver Sangineto … Elisa RicciSpringer LNCS · University of Trento · Télécom Paris · +2
    PDF ↗
  11. 2020
    Class-Incremental Domain AdaptationJogendra Nath Kundu, Rahul Venkatesh, Naveen Venkat … R. Venkatesh BabuSpringer LNCS · Indian Institute of Science Bangalore
    PDF ↗
  12. 2020
    Sequential Learning for Domain GeneralizationDa Li, Yongxin Yang, Yi-Zhe Song, Timothy M. HospedalesSpringer LNCS · Samsung (United Kingdom) · University of Edinburgh · +1
    PDF ↗
  13. 2021
    Piggyback GAN: Efficient Lifelong Learning for Image Conditioned GenerationMengyao Zhai, Lei Chen, Jiawei He … Greg MoriSpringer LNCS · Simon Fraser University · Collège Boréal
    PDF ↗
  14. 2020
    Incremental Few-Shot Meta-learning via Indirect Discriminant AlignmentQing Liu, Orchid Majumder, Alessandro Achille … Stefano SoattoSpringer LNCS · Johns Hopkins University · Amazon (United States)
  15. 2020
    Action Localization through Continual Predictive LearningSathyanarayanan N. Aakur, Sudeep SarkarSpringer LNCS · Oklahoma State University · Oklahoma State University Oklahoma City · +1
    PDF ↗
  16. 2020
    Active Class Incremental Learning for Imbalanced DatasetsEden Belouadah, Adrian Popescu, Umang Aggarwal, Léo SaciSpringer LNCS · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +1
    PDF ↗
  17. 2020
    What am I allowed to do here?: Online Learning of Context-Specific Norms by PepperAli Ayub, Alan R. WagnerSpringer LNCS · Pennsylvania State University
    PDF ↗
  18. 2020
    Continual Class Incremental Learning for CT Thoracic SegmentationAbdelrahman Elskhawy, Aneta Lisowska, Matthias Keicher … Nassir NavabSpringer LNCS · Medical Research Scotland · Canon (United Kingdom) · +2
    PDF ↗
  19. 2019
    Continual Learning of Image Translation Networks Using Task-Dependent Weight Selection MasksMatsumoto Asato, ‪Keiji Yanai‬Springer LNCS · University of Electro-Communications
  20. 2020
    Object Tracking Through Residual and Dense LSTMsFabio Garcea, Alessandro Cucco, Lia Morra, Fabrizio LambertiSpringer LNCS · Politecnico di Torino
    PDF ↗
  21. 2020
    An Incremental Learning Network Model Based on Random Sample Distribution FittingWencong Wang, Lan Huang, Hao Liu … Kangping WangSpringer LNCS · Jilin University · Jilin Province Science and Technology Department
  22. 2018
    DeeSIL: Deep-Shallow Incremental LearningEden Belouadah, Adrian PopescuSpringer LNCS · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies
    PDF ↗
  23. 2018
    Revisiting Distillation and Incremental Classifier LearningKhurram Javed, Faisal ShafaitSpringer LNCS · National University of Sciences and Technology
    PDF ↗
  24. 2018
    Adding New Tasks to a Single Network with Weight Trasformations using Binary MasksMassimiliano Mancini, Elisa Ricci, Barbara Caputo, Samuel Rota BulòSpringer LNCS · Fondazione Bruno Kessler · Sapienza University of Rome · +2
    PDF ↗
  25. 2018
    Marginal Replay vs Conditional Replay for Continual LearningTimothée Lesort, Alexander Gepperth, Andrei Stoian, David FilliatSpringer LNCS · École Nationale Supérieure de Techniques Avancées · Thales (France) · +1
    PDF ↗
  26. 2019
    A Study on Catastrophic Forgetting in Deep LSTM NetworksMonika Schak, Alexander GepperthSpringer LNCS · Fulda University of Applied Sciences
  27. 2019
    Continual Learning Exploiting Structure of Fractal Reservoir ComputingTaisuke Kobayashi, Toshiki SuginoSpringer LNCS · Nara Institute of Science and Technology
  28. 2019
    Strategies for Improving Single-Head Continual Learning PerformanceAlaa El Khatib, Fakhri KarraySpringer LNCS · University of Waterloo
  29. 2019
    Simplified Computation and Interpretation of Fisher Matrices in Incremental Learning with Deep Neural NetworksAlexander Gepperth, Florian WiechSpringer LNCS · Fulda University of Applied Sciences
  30. 2019
    Overcoming Catastrophic Interference with Bayesian Learning and Stochastic Langevin DynamicsMikhail Leontev, Alexander Mikheev, Kirill Sviatov, Sergey SukhovSpringer LNCS · Ulyanovsk State University · Kotelnikov Institute of Radioengineering and Electronics of the Russian Academy of Sciences · +1
  31. 2019
    Lifelong Learning Starting From ZeroClaes Strannegård, Herman Carlström, Niklas Engsner … Morteza Haghir ChehreghaniSpringer LNCS · Chalmers University of Technology
    PDF ↗
  32. 2019
    MaxEntropy Pursuit Variational InferenceEvgenii Egorov, Kirill Neklydov, Ruslan Kostoev, Evgeny BurnaevSpringer LNCS · Skolkovo Institute of Science and Technology · National Research University Higher School of Economics · +1
    PDF ↗
  33. 2019
    Central-Diffused Instance Generation Method in Class Incremental LearningMing-Yu Liu, Yijie WangSpringer LNCS · National University of Defense Technology
  34. 2017
    Memory Aware Synapses: Learning what (not) to forgetRahaf Aljundi, Francesca Babiloni, Mohamed Elhoseiny … Tinne TuytelaarsSpringer LNCS · IMEC · KU Leuven · +2
    PDF ↗
  35. 2018
    Distractor-aware Siamese Networks for Visual Object TrackingZheng Zhu, Qiang Wang, Bo Li … Weiming HuSpringer LNCS · Chinese Academy of Sciences · Shandong Institute of Automation · +2
    PDF ↗
  36. 2018
    Riemannian Walk for Incremental Learning: Understanding Forgetting and IntransigenceArslan Chaudhry, Puneet K. Dokania, Thalaiyasingam Ajanthan, Philip H. S. TorrSpringer LNCS · University of Oxford
    PDF ↗
  37. 2018
    End-to-End Incremental LearningFrancisco M. Castro, Manuel J. Marín‐Jiménez, Nicolás Guil … Karteek AlahariSpringer LNCS · Universidad de Málaga · University of Córdoba · +5
    PDF ↗
  38. 2018
    Lifelong Learning via Progressive Distillation and RetrospectionSaihui Hou, Xinyu Pan, Chen Change Loy … Dahua LinSpringer LNCS · University of Science and Technology of China · Chinese University of Hong Kong · +1
  39. 2018
    A Lifelong Learning Approach to Brain MR Segmentation Across Scanners and ProtocolsNeerav Karani, Krishna Chaitanya, Christian F. Baumgartner, Ender KonukoğluSpringer LNCS · ETH Zurich
    PDF ↗
  40. 2018
    Learn the new, keep the old: Extending pretrained models with new anatomy and imagesFırat Özdemir, Philipp Fuernstahl, Orçun GökselSpringer LNCS · ETH Zurich · University of Zurich · +1
    PDF ↗
  41. 2018
    Catastrophic Forgetting: Still a Problem for DNNsBenedikt Pfülb, Alexander Gepperth, Syahrul Afzal Che Abdullah, Axel KilianSpringer LNCS · Fulda University of Applied Sciences
    PDF ↗
  42. 2018
    Overcoming Catastrophic Forgetting in Convolutional Neural Networks by Selective Network AugmentationAbel Zacarias, Luı́s A. AlexandreSpringer LNCS · University of Beira Interior · Instituto de Telecomunicações
    PDF ↗
  43. 2018
    A Broad Neural Network Structure for Class Incremental LearningWenzhang Liu, Haiqin Yang, Yuewen Sun, Changyin SunSpringer LNCS · Southeast University · Hang Seng University of Hong Kong
  44. 2018
    Overcoming Catastrophic Forgetting with Self-adaptive IdentifiersFangzhou Xiong, Zhiyong Liu, Xu YangSpringer LNCS · Shandong Institute of Automation · University of Chinese Academy of Sciences · +2
  45. 2017
    Interactive Machine Learning Applied to Dribble a Ball in Soccer with Biped RobotsCarlos Celemin, Rodrigo Pérez‐Dattari, Javier Ruíz-del-Solar, Manuela VelosoSpringer LNCS · University of Chile · Carnegie Mellon University
  46. 2018
    On Capacity with Incremental Learning by Simplified Chaotic Neural NetworkToshinori Deguchi, Naohiro IshiiSpringer LNCS · National Institute of Technology, Gifu College · Aichi Institute of Technology
  47. 2017
    Continual and One-Shot Learning Through Neural Networks with Dynamic External MemoryBenno Lüders, Mikkel Schläger, Aleksandra Korach, Sebastian RisiSpringer LNCS · IT University of Copenhagen
  48. 2016
    Comparing Incremental Learning Strategies for Convolutional Neural NetworksVincenzo Lomonaco, Davide MaltoniSpringer LNCS · University of Bologna
  49. 2016
    Analytical Incremental Learning: Fast Constructive Learning Method for Neural NetworkSyukron Abu Ishaq Alfarozi, Noor Akhmad Setiawan, Teguh Bharata Adji … Masanori SugimotoSpringer LNCS · Universitas Gadjah Mada · King Mongkut's Institute of Technology Ladkrabang · +1
  50. 2015
    PICKT: A Solution for Big Data AnalysisTianrui Li, Chuan Luo, Hongmei Chen, Junbo ZhangSpringer LNCS · Southwest Jiaotong University
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.