Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

267 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2018
    Pseudo-Rehearsal: Achieving Deep Reinforcement Learning without Catastrophic ForgettingCraig Atkinson, Brendan McCane, Lech Szymanski, Anthony RobinsNeurocomputing · University of Otago
    PDF ↗
  2. 2018
    StackNet: Stacking feature maps for Continual learningKim Jangho, Jeesoo Kim, Nojun KwakCVPR · Seoul National University
    PDF ↗
  3. 2018
    Self-Net: Lifelong Learning via Continual Self-ModelingJaya Krishna Mandivarapu, Blake Camp, Rolando EstradaFrontiers · Georgia State University
    PDF ↗
  4. 2018PDF ↗
  5. 2018
    Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed RepresentationsAlexander G. Ororbia, Ankur Mali, C. Lee Giles, Daniel KiferTNNLS · Rochester Institute of Technology · Pennsylvania State University
    PDF ↗
  6. 2018
    Tree-CNN: A hierarchical Deep Convolutional Neural Network for incremental learningDeboleena Roy, Priyadarshini Panda, Kaushik RoyNeural Networks · Purdue University West Lafayette
    PDF ↗
  7. 2018
    Toward an AI Physicist for Unsupervised LearningTailin Wu, Max TegmarkPhysical review. E · Theiss Research · Massachusetts Institute of Technology
    PDF ↗
  8. 2018
    Continual learning of context-dependent processing in neural networksGuanxiong Zeng, Yang Chen, Bo Cui, Shan YuNature Machine Intelligence · Chinese Academy of Sciences · Institute of Automation · +2
    PDF ↗
  9. 2018
    DynMat, a network that can learn after learningJung H. LeePubMed · Allen Institute for Brain Science · Allen Institute
    PDF ↗
  10. 2018
    Closed-Loop Memory GAN for Continual LearningAmanda Rios, Laurent IttiIJCAI · University of Southern California · California Southern University
  11. 2018
    Towards AutoML in the presence of Drift: first resultsJorge G. Madrid, Hugo Jair Escalante, Eduardo F. Morales … Michèle SébagIJCAI · National Institute of Astrophysics, Optics and Electronics · Nanjing University · +2
    PDF ↗
  12. 2018
    The Utility of Sparse Representations for Control in Reinforcement LearningVincent Liu, Raksha Kumaraswamy, Lei Le, Martha WhiteAAAI · University of Alberta · Indiana University Bloomington
    PDF ↗
  13. 2018
    Robust Associative Learning Is Sufficient to Explain the Structural and Dynamical Properties of Local Cortical CircuitsDanke Zhang, Chi Zhang, Armen StepanyantsJournal of Neuroscience · Northeastern University
  14. 2018
    Generative Models from the perspective of Continual LearningTimothée Lesort, Hugo Caselles-Dupré, Michael Garcia-Ortiz … David FilliatIEEE International Joint Conference on Neural Network · Institut national de recherche en sciences et technologies du numérique · École Nationale Supérieure de Techniques Avancées · +2
    PDF ↗
  15. 2018
    A Class-Incremental Learning Method Based on One Class Support Vector MachineChengfei Yao, Jie Zou, Yanan Luo … Gang BaiJournal of Physics Conference Series · Nankai University
    PDF ↗
  16. 2018
    Learning Without MemorizingPrithviraj Dhar, Rajat Singh, Kuan–Chuan Peng … Rama ChellappaCVPR · University of Maryland, College Park · Siemens (Germany)
    PDF ↗
  17. 2018
    Task-Free Continual LearningRahaf Aljundi, Klaas Kelchtermans, Tinne TuytelaarsCVPR · KU Leuven
    PDF ↗
  18. 2018
    A Perceptual Prediction Framework for Self Supervised Event SegmentationSathyanarayanan N. Aakur, Sudeep SarkarCVPR · University of South Florida
    PDF ↗
  19. 2018
    Generic Evolving Self-Organizing Neuro-Fuzzy Control of Bio-Inspired Unmanned Aerial VehiclesMd Meftahul Ferdaus, Mahardhika Pratama, Sreenatha G. Anavatti … Yongping PanIEEE Transactions · University of Canberra · UNSW Sydney · +3
    PDF ↗
  20. 2018
    Autonomous Deep Learning: Continual Learning Approach for Dynamic EnvironmentsAndri Ashfahani, Mahardhika PratamaSociety for Industrial and Applied Mathematics eBooks
    PDF ↗
  21. 2018
    Deep stacked stochastic configuration networks for lifelong learning of non-stationary data streamsMahardhika Pratama, Dianhui WangInformation Sciences · Nanyang Technological University · La Trobe University · +1
    PDF ↗
  22. 2018
    Memory Efficient Experience Replay for Streaming LearningTyler L. Hayes, Nathan D. Cahill, Christopher KananICRA · Rochester Institute of Technology
    PDF ↗
  23. 2018
    Three scenarios for continual learningGido M. van de Ven, Andreas S. ToliasNeurIPS
    PDF ↗
  24. 2018
    Continuous Learning in Single-Incremental-Task ScenariosDavide Maltoni, Vincenzo LomonacoNeural Networks · University of Bologna
    PDF ↗
  25. 2018
    A Unifying Bayesian View of Continual LearningSebastian Farquhar, Yarin GalNeurIPS · University of Oxford
    PDF ↗
  26. 2018
    Viscovery: Trend Tracking in Opinion Forums based on Dynamic Topic ModelsIgnacio Espinoza, Marcelo Mendoza, Pablo Ortega … Fernanda WeissJournal of Digital Information Management · Federico Santa María Technical University
    PDF ↗
  27. 2018
    Active Learning for Deep Object DetectionClemens-Alexander Brust, Christoph Käding, Joachim DenzlerInternational Joint Conference on Computer Vision, Imagin… · Friedrich Schiller University Jena
    PDF ↗
  28. 2018
    DeeSIL: Deep-Shallow Incremental LearningEden Belouadah, Adrian PopescuSpringer LNCS · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies
    PDF ↗
  29. 2018
    Revisiting Distillation and Incremental Classifier LearningKhurram Javed, Faisal ShafaitSpringer LNCS · National University of Sciences and Technology
    PDF ↗
  30. 2018
    An Incremental Construction of Deep Neuro Fuzzy System for Continual Learning of Nonstationary Data StreamsMahardhika Pratama, Witold Pedrycz, Geoffrey I. WebbIEEE Transactions · Nanyang Technological University · University of Alberta · +1
    PDF ↗
  31. 2018
    Adding New Tasks to a Single Network with Weight Trasformations using Binary MasksMassimiliano Mancini, Elisa Ricci, Barbara Caputo, Samuel Rota BulòSpringer LNCS · Fondazione Bruno Kessler · Sapienza University of Rome · +2
    PDF ↗
  32. 2018
    Marginal Replay vs Conditional Replay for Continual LearningTimothée Lesort, Alexander Gepperth, Andrei Stoian, David FilliatSpringer LNCS · École Nationale Supérieure de Techniques Avancées · Thales (France) · +1
    PDF ↗
  33. 2018
    Lifelong Learning Maxent for Suggestion ClassificationThi-Lan Ngo, Tu Vu, Hideaki Takeda … Xuan-Hieu PhanComputación y Sistemas
  34. 2018
    Graph clustering based size varying rules for lifelong topic modellingMuhammad Taimoor Khan, Shehzad Khalid, Furqan AzizGlobal Journal of Computer Sciences Theory and Research · Bahria University · Institute of Management Sciences Peshawar
  35. 2018
    Graph Clustering Based Size Varying Rules for Lifelong Topic ModelingMahrukh Khan, Shehzad Khalid, Furqan Aziz2018 5th International Conference on Bioinformatics Resea… · National University of Computer and Emerging Sciences · Bahria University · +1
  36. 2018
    Self-organizing maps for storage and transfer of knowledge in reinforcement learningThommen George Karimpanal, Roland BouffanaisAdaptive Behavior · Singapore University of Technology and Design
    PDF ↗
  37. 2018
    Good Trouble: Post-tenure Interruptions to Our Academic ‘Routines’Nick TobierMetropolitan Universities · University of Michigan
  38. 2018
    Continual Match Based Training in Pommerman: Technical ReportPeng Peng, Liang Pang, Yufeng Yuan, Chao GaoarXiv
    PDF ↗
  39. 2018
    Reconciling meta-learning and continual learning with online mixtures of tasksGhassen Jerfel, Erin Grant, T. Griffiths, K. HellerNeurIPS
  40. 2018
    An Empirical Study of Example Forgetting during Deep Neural Network LearningMariya Toneva, Alessandro Sordoni, Rémi Tachet des Combes … Geoffrey J. GordonICLR · Carnegie Mellon University · Microsoft (United States) · +1
    PDF ↗
  41. 2018PDF ↗
  42. 2018
    Continual Learning Augmented Investment DecisionsDaniel Philps, Tillman Weyde, Artur d’Avila Garcez, Roy BatchelorarXiv · City, University of London
    PDF ↗
  43. 2018
    Transfer Incremental Learning using Data AugmentationGhouthi Boukli Hacene, Vincent Gripon, Nicolas Farrugia … Michel JézéquelApplied Sciences · Université de Bretagne Occidentale · Laboratoire des Sciences et Techniques de l’Information de la Communication et de la Connaissance · +2
    PDF ↗
  44. 2018
    Overcoming Catastrophic Forgetting by Soft Parameter PruningJian Peng, Hao, Jiang, Zhuo Li … Haifeng LiarXiv
    PDF ↗
  45. 2018
    Few-Shot Self Reminder to Overcome Catastrophic ForgettingJunfeng Wen, Yanshuai Cao, Ruitong HuangarXiv
    PDF ↗
  46. 2018
    Efficient Lifelong Learning with A-GEMArslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, Mohamed ElhoseinyICLR
    PDF ↗
  47. 2018
    Task Runtime Prediction in Scientific Workflows Using an Online Incremental Learning ApproachMuhammad Hafizhuddin Hilman, Maria A. Rodriguez, Rajkumar BuyyaInternational Conference on Utility and Cloud Computing · The University of Melbourne
    PDF ↗
  48. 2018
    Lifelong Learning Memory Networks for Aspect Sentiment ClassificationShuai Wang, Guangyi Lv, Sahisnu Mazumder … Bing LiuIEEE International Conference on Big Data (Big Data) · University of Illinois Chicago · University of Science and Technology of China
  49. 2018
    Incremental Learning of Single-stage Detectors with Mining Memory NeuronsWei Li, Qingbo Wu, Linfeng Xu, Chao ShangIEEE 4th International Conference on Computer and Communi… · University of Electronic Science and Technology of China
  50. 2018
    Big Data Ingestion and Lifelong Learning ArchitectureGautam Pal, Gangmin Li, Katie AtkinsonIEEE International Conference on Big Data (Big Data) · University of Liverpool · Xi’an Jiaotong-Liverpool University
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.