Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

460 papers of 8,653 · showing 151–200Sort Recent · Most cited
  1. 2020
    Meta-Consolidation for Continual LearningK J Joseph, Vineeth N BalasubramanianNeurIPS · Indian Institute of Technology Hyderabad
    PDF ↗
  2. 2020
    Natural Way to Overcome the Catastrophic Forgetting in Neural NetworksА.А. КуталевSovremennye informacionnye tehnologii i IT-obrazovanie.
    PDF ↗
  3. 2020
    Continual Learning Of Predictive Models In Video Sequences Via Variational AutoencodersDamian Campo, Giulia Slavic, Mohamad Baydoun … Carlo S. RegazzoniInternational Conference on Information Photonics · University of Genoa
    PDF ↗
  4. 2020
    Deep Inhomogeneous Regularization For Transfer LearningWen Wang, Wei Zhai, Yang CaoICIP · University of Science and Technology of China
  5. 2020
    Class Incremental Learning With Task-SelectionEun Sung Kim, Jung Uk Kim, Sangmin Lee … Yong Man RoICIP · Korea Advanced Institute of Science and Technology · Korea Electric Power Corporation (South Korea)
  6. 2020
    Faster ILOD: Incremental Learning for Object Detectors based on Faster RCNNCan Peng, Kun Zhao, Brian C. LovellPattern Recognition Letters · The University of Queensland
    PDF ↗
  7. 2020
    Metaplasticity in Multistate Memristor Synaptic NetworksFatima Tuz Zohora, Abdullah M. Zyarah, Nicholas Soures, Dhireesha KudithipudiInternational Symposium on Circuits and Systems · The University of Texas at San Antonio · Rochester Institute of Technology
    PDF ↗
  8. 2020
    Meta-Aggregating Networks for Class-Incremental LearningYaoyao Liu, B. Schiele, Qianru SunarXiv
  9. 2020
    Neurocoder: Learning General-Purpose Computation Using Stored Neural ProgramsHung Lê, Svetha VenkatesharXiv · Deakin University
    PDF ↗
  10. 2020
    Memory-Latency-Accuracy Trade-Offs for Continual Learning on a RISC-V Extreme-Edge NodeLeonardo Ravaglia, Manuele Rusci, Alessandro Capotondi … Luca BeniniIEEE Workshop on Signal Processing Systems · University of Bologna · University of Modena and Reggio Emilia · +1
    PDF ↗
  11. 2020
    Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the JobBing Liu, Sahisnu MazumderarXiv · University of Illinois Chicago
    PDF ↗
  12. 2020
    Class-Incremental Learning for Semantic Segmentation Re-Using Neither Old Data Nor Old LabelsMarvin Klingner, Andreas Bär, Philipp Donn, Tim FingscheidtIEEE 23rd International Conference on Intelligent Transpo… · Technische Universität Braunschweig
    PDF ↗
  13. 2020
    ADER: Adaptively Distilled Exemplar Replay Towards Continual Learning for Session-based RecommendationFei Mi, Xiaoyu Lin, Boi FaltingsRecSys · École Polytechnique Fédérale de Lausanne
    PDF ↗
  14. 2020
    Exploring Neuromodulation for Dynamic LearningAnurag Daram, Ángel Yanguas-Gil, Dhireesha KudithipudiFrontiers · The University of Texas at San Antonio · Argonne National Laboratory
  15. 2020
    Incremental learning based multi-domain adaptation for object detectionXing Wei, Shaofan Liu, Yaoci Xiang … Yang LuKnowledge-Based Systems · Hefei University of Technology
  16. 2020
    Few-Shot Unsupervised Continual Learning through Meta-ExamplesAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniarXiv · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  17. 2020
    On stability and associative recall of memories in attractor neural networksSuchitra Sampath, Vipin SrivastavaPLOS · University of Hyderabad
  18. 2020
    Incremental learning model inspired in Rehearsal for deep convolutional networksDavid A. Muñoz, Camilo Narváez, Carlos Cobos … Francisco HerreraKnowledge-Based Systems · University of Cauca · Universidad de Granada · +1
  19. 2020
    Measuring Information Transfer in Neural NetworksXiao Zhang, Xingjian Li, Dejing Dou, Ji WuarXiv · Tsinghua University · Baidu (China)
    PDF ↗
  20. 2020
    Meta-Learning with Sparse Experience Replay for Lifelong Language LearningNithin Holla, Pushkar Mishra, Helen Yannakoudakis, Ekaterina ShutovaarXiv · Meta (Israel) · King's College London · +1
    PDF ↗
  21. 2020
    Routing Networks with Co-training for Continual LearningMark Collier, Efi Kokiopoulou, Andréa Gesmundo, Jesse BerentarXiv · Google (United States)
    PDF ↗
  22. 2020
    Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language ModellingTsendsuren MunkhdalaiarXiv · Microsoft Research (United Kingdom)
    PDF ↗
  23. 2020
    Compression-aware Continual Learning using Singular Value DecompositionVarigonda Pavan Teja, Priyadarshini PandaarXiv · Yale University
    PDF ↗
  24. 2020
    Keynote Lecture - Building Knowledge For AI AgentsWith Reinforcement LearningDoina PrecupIEEE 16th International Conference on Intelligent Compute… · Google DeepMind (United Kingdom) · McGill University
  25. 2020
    Lifelong Object DetectionZhou Wang, Shiyu Chang, Norma Sosa … David CoxarXiv
    PDF ↗
  26. 2020
    Deep Neural Networks: Incremental LearningRama Murthy Garimella, Maha Lakshmi Bairaju, G. C. Jyothi Prasanna … Manasa JagannadanAdvances in intelligent systems and computing · Mahindra University · Rajiv Gandhi University of Knowledge Technologies
  27. 2020
    A Survey of Multi-Task Deep Reinforcement LearningNelson Vithayathil Varghese, Qusay H. MahmoudElectronics · Ontario Tech University
  28. 2020
    CUE: A unified spiking neuron model of short-term and long-term memory.Jan Gosmann, Chris EliasmithPsychological Review · University of Waterloo
  29. 2020PDF ↗
  30. 2020
    Brain-inspired replay for continual learning with artificial neural networksGido M. van de Ven, Hava T. Siegelmann, Andreas S. ToliasNature Communications · Baylor College of Medicine · University of Cambridge · +3
  31. 2020
    Catastrophic Interference in Predictive Neural Network Models of Distributional SemanticsWilla Mannering, Michael N. JonesComputational Brain & Behavior · Indiana University Bloomington
  32. 2020
    Reinforcement learning for quadrupedal locomotion with design of continual-hierarchical curriculumTaisuke Kobayashi, Toshiki SuginoEng. Applications of AI · Nara Institute of Science and Technology
  33. 2020
    SLER: Self-generated long-term experience replay for continual reinforcement learningChunmao Li, Li Yang, Yin-Liang ZHAO … Xupeng GengApplied Intelligence
  34. 2020
    Deep online classification using pseudo-generative modelsA. G. Besedin, Pierre Blanchart, Michel Crucianu, Marin FerecatuComputer Vision and Image Understanding · Conservatoire National des Arts et Métiers · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · +2
  35. 2020
    Emergence of Stable Synaptic Clusters on Dendrites Through Synaptic RewiringThomas Limbacher, Robert LegensteinFrontiers · Graz University of Technology
  36. 2020
    Meta Continual Learning via Dynamic ProgrammingKrishnan, R., Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  37. 2020
    Can sleep protect memories from catastrophic forgetting?Oscar C González, Yury Sokolov, Giri P Krishnan … Maxim BazhenoveLife · University of California San Diego
  38. 2020
    Continual Learning for Affective Robotics: Why, What and How?Nikhil Churamani, Sinan Kalkan, Hatice GüneşIEEE International Conference on Robot and Human Interact… · University of Cambridge · Middle East Technical University
  39. 2020
    Dynamically Growing Neural Network Architecture for Lifelong Deep Learning on the EdgeDuvindu Piyasena, Miyuru Thathsara, Sathursan Kanagarajah … Meiqing WuInternational Conference on Field-Programmable Logic and… · Nanyang Technological University
  40. 2020
    Lifelong NavigationBo Liu, Xuesu Xiao, Peter StonearXiv · The University of Texas at Austin
    PDF ↗
  41. 2020
    Continuous Learning in a Single-Incremental-Task Scenario with Spike FeaturesRuthvik Vaila, John Chiasson, Vishal SaxenaInternational Conference on Systems · Boise State University · University of Delaware
    PDF ↗
  42. 2020
    La-MAML: Look-ahead Meta Learning for Continual LearningGunshi Gupta, Karmesh Yadav, Liam PaullNeurIPS · Carnegie Mellon University · Université de Montréal
    PDF ↗
  43. 2020PDF ↗
  44. 2020
    Convolutional Neural Network With Developmental Memory for Continual LearningGyeong-Moon Park, Sahng-Min Yoo, Jong-Hwan KimTNNLS · Electronics and Telecommunications Research Institute · Korea Advanced Institute of Science and Technology
  45. 2020
    Boosting Deep Open World Recognition by ClusteringDario Fontanel, Fabio Cermelli, Massimiliano Mancini … Barbara CaputoRA-L · Politecnico di Torino · Italian Institute of Technology · +4
    PDF ↗
  46. 2020
  47. 2020
    Multilayer Neuromodulated Architectures for Memory-Constrained Online Continual LearningSandeep Madireddy, Ángel Yanguas-Gil, Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  48. 2020
    Lifelong Learning of Compositional StructuresJorge A. Mendez, Eric EatonICLR · California University of Pennsylvania · University of Pennsylvania
    PDF ↗
  49. 2020
    Anatomy of Catastrophic Forgetting: Hidden Representations and Task SemanticsVinay Ramasesh, Ethan Dyer, Maithra RaghuICLR · Google (United States) · Cornell University
    PDF ↗
  50. 2020
    Lifelong Policy Gradient Learning of Factored Policies for Faster Training Without ForgettingJorge A. Mendez, Boyu Wang, Eric EatonNeurIPS · California University of Pennsylvania · University of Pennsylvania · +1
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.