Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

42 papers of 8,653Sort Recent · Most cited
  1. 2016
    iCaRL: Incremental Classifier and Representation LearningSylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, Christoph H. LampertCVPR · Institute of Science and Technology Austria
    PDF ↗
  2. 2016
    Expert Gate: Lifelong Learning with a Network of ExpertsRahaf Aljundi, Punarjay Chakravarty, Tinne TuytelaarsCVPR · IMEC
    PDF ↗
  3. 2016
    Overcoming catastrophic forgetting in neural networksJames Kirkpatrick, Razvan Pascanu, Neil C. Rabinowitz … Raia HadsellPNAS · Google DeepMind (United Kingdom) · Imperial College London
    PDF ↗
  4. 2016
    A Deep Hierarchical Approach to Lifelong Learning in MinecraftChen Tessler, Shahar Givony, Tom Zahavy … Shie MannorAAAI · Technion – Israel Institute of Technology
    PDF ↗
  5. 2016
    A Joint Many-Task Model: Growing a Neural Network for Multiple NLP TasksKazuma Hashimoto, Caiming Xiong, Yoshimasa Tsuruoka, Richard SocherEMNLP · Salesforce (United States) · The University of Tokyo
    PDF ↗
  6. 2016
    Lifelong Machine LearningZhiyuan Chen, Bing LiuMachine Learning · Google (United States) · University of Illinois Chicago
  7. 2016
    On Pattern Generating Methods for Incremental Learning by Chaotic Neural NetworkToshinori Deguchi, Naohiro IshiiIntl Conf on Applied Computing and Information Technology… · National Institute of Technology, Gifu College · Aichi Institute of Technology
  8. 2016
    Differentiable Programs with Neural LibrariesAlexander L. Gaunt, Marc Brockschmidt, Nate Kushman, Daniel TarlowICML · Microsoft (United States)
    PDF ↗
  9. 2016PDF ↗
  10. 2016
    Incremental learning for bootstrapping object classifier modelsCem Karaoguz, Alexander GepperthIEEE Conference Proceedings · Institut national de recherche en sciences et technologies du numérique · École Nationale Supérieure de Techniques Avancées · +1
    PDF ↗
  11. 2016
    A Growing Long-term Episodic & Semantic MemoryMarc Pickett, Rami Al‐Rfou, Louis Shao, Chris TararXiv
    PDF ↗
  12. 2016
    Incremental One-Class Models for Data ClassificationTakoua Kefi, Riadh Ksantini, Mohamed Kaâniche, Adel BouhoulaarXiv
    PDF ↗
  13. 2016
    Incremental learning of neural network classifiers using reinforcement learningSourabh Bose, Manfred HuberIEEE Conference Proceedings · The University of Texas at Arlington
  14. 2016
    A novel progressive multi-label classifier for class-incremental dataMihika Dave, Sahil Tapiawala, Meng Joo Er, Rajasekar VenkatesanIEEE International Conference on Systems, Man and Cyberne… · Birla Institute of Technology and Science, Pilani · Nanyang Technological University
    PDF ↗
  15. 2016PDF ↗
  16. 2016
    Incremental Learning on Non-stationary Data Stream using Ensemble ApproachMeenakshi Thalor, S. T. PatilInternational Journal of Electrical and Computer Engineer… · Savitribai Phule Pune University · Institute of Engineering
  17. 2016
    Less-forgetting Learning in Deep Neural NetworksHeechul Jung, Jeongwoo Ju, Minju Jung, Junmo KimarXiv
    PDF ↗
  18. 2016
    Progressive Neural NetworksAndrei A. Rusu, Neil C. Rabinowitz, Guillaume Desjardins … Raia HadsellarXiv
    PDF ↗
  19. 2016
    Incremental learning of perceptual and conceptual representations and the puzzle of neural repetition suppressionStephen J. GottsPsychonomic Bulletin & Review · National Institutes of Health · National Institute of Mental Health
    PDF ↗
  20. 2016
    Active Long Term Memory NetworksTommaso Furlanello, Jiaping Zhao, Andrew Saxe … Bosco S. TjanarXiv
    PDF ↗
  21. 2016
    On the Effects of Spam Filtering and Incremental Learning for Web-Supervised Visual Concept ClassificationMatthias Springstein, Ralph Ewerth2016 ACM on International Conference on Multimedia Retrieval · Technische Informationsbibliothek (TIB) · Leibniz University Hannover
  22. 2016
    One-shot Learning with Memory-Augmented Neural NetworksAdam Santoro, Sergey Bartunov, Matthew Botvinick … Timothy LillicraparXiv
    PDF ↗
  23. 2016
    Incremental Object Recognition in Robotics with Extension to New Classes in Constant TimeR. Camoriano, Giulia Pasquale, C. Ciliberto … G. MettaarXiv
    PDF ↗
  24. 2016
    Online Open World RecognitionRocco De Rosa, Thomas Mensink, Barbara CaputoarXiv
    PDF ↗
  25. 2016
    Lifelong aspect extraction from big data: knowledge engineeringMahrukh Khan, Mehr Yahya Durrani, Shehzad Khalid, Furqan AzizComplex Adaptive Systems Modeling · Bahria University · COMSATS University Islamabad · +1
  26. 2016
    Semantic video labeling by developmental visual agentsMarco Gori, Marco Lippi, Marco Maggini, Stefano MelacciComputer Vision and Image Understanding · University of Siena · University of Bologna
  27. 2016
    Towards Lifelong Object Learning by Integrating Situated Robot Perception and Semantic Web MiningYoung Jay, Valerio Basile, Kunze Lars … Nick HawesFrontiers · University of Birmingham · Laboratoire d'Informatique, Signaux et Systèmes de Sophia Antipolis
  28. 2016
    Comparing Incremental Learning Strategies for Convolutional Neural NetworksVincenzo Lomonaco, Davide MaltoniSpringer LNCS · University of Bologna
  29. 2016
    Analytical Incremental Learning: Fast Constructive Learning Method for Neural NetworkSyukron Abu Ishaq Alfarozi, Noor Akhmad Setiawan, Teguh Bharata Adji … Masanori SugimotoSpringer LNCS · Universitas Gadjah Mada · King Mongkut's Institute of Technology Ladkrabang · +1
  30. 2016
    One-Class to Multi-Class Model Update Using the Class-Incremental Optimum-Path Forest ClassifierMateus Riva, Moacir Antonelli Ponti, de Campos TeofiloFrontiers · Universidade de São Paulo · University of Surrey
  31. 2016
    A Clastering Method for Incremental Learning using ESOINN and Counter Propagation Neural NetworksShunsuke Kawai, Satoshi YamaguchiIEEJ Transactions on Electronics Information and Systems · Chiba Institute of Technology
    PDF ↗
  32. 2016
    On Learning Parameters of Incremental Learning in Chaotic Neural NetworkToshinori Deguchi, Naohiro IshiiSpringer CCIS · National Institute of Technology, Gifu College · Aichi Institute of Technology
  33. 2016
    Continual Learning through Evolvable Neural Turing MachinesBenno Lüders, Mikkel Schläger, S. RisiNeurIPS
  34. 2016
  35. 2016
  36. 2016
  37. 2016
  38. 2016
    Learning without ForgettingAuthors pendingECCV
    PDF ↗
  39. 2016
  40. 2016PDF ↗
  41. 2016
    Net2Net: Accelerating Learning via Knowledge TransferTianqi Chen, Ian Goodfellow, Jonathon ShlensICLR · University of Washington · Google (United States)
    PDF ↗
  42. 2016
    Incremental Learning of Convolutional Neural NetworksDušan Medera, Štefan BabinecInternational Joint Conference on Computational Intelligence
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.