Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

661 papers of 8,653 · showing 151–200Sort Recent · Most cited
  1. 2021
    Reviewing continual learning from the perspective of human-level intelligenceYifan Chang, Wenbo Li, Jian Peng … Haifeng LiarXiv
    PDF ↗
  2. 2021
    Incremental sequential three-way decision based on continual learning networkHongyuan Li, Hong Yu, Hong Yu … Huaxiong LiInternational Journal of Machine Learning and Cybernetics · Nanjing University · Chongqing University of Posts and Telecommunications · +2
  3. 2021
    Learning by Active Forgetting for Neural NetworksJian Peng, Xian Sun, Min Deng … Haifeng LiarXiv · Central South University
    PDF ↗
  4. 2021
    Beyond gradients: Factorized, geometric control of interference and generalizationDavid M. Scott, Michael J. FrankbioRxiv · Brown University · Allen Institute for Brain Science
  5. 2021
    Defeating Catastrophic Forgetting via Enhanced Orthogonal Weights ModificationYanni Li, Bing Liu, Kaicheng Yao … Jiangtao CuiarXiv
    PDF ↗
  6. 2021
    Lifelong Reinforcement Learning with Temporal Logic Formulas and Reward MachinesXuejing Zheng, Chao Yu, Chen Chen … Hankz Hankui ZhuoarXiv
    PDF ↗
  7. 2021
    Self-Supervised Class Incremental LearningZixuan Ni, Siliang Tang, Yueting ZhuangarXiv
    PDF ↗
  8. 2021
    Continual Learning via Local Module CompositionOleksiy Ostapenko, Pau Rodríguez, M. Caccia, Laurent CharlinNeurIPS · Taras Shevchenko National University of Kyiv · University of Insubria · +1
    PDF ↗
  9. 2021
    Target Layer Regularization for Continual Learning Using Cramer-Wold GeneratorMarcin Mazur, Łukasz Pustelnik, Szymon Knop … Przemysław SpurekarXiv
    PDF ↗
  10. 2021
    Memory Model for Morphological Semantics of Visual Stimuli Using Sparse Distributed RepresentationKyuchang Kang, Changseok BaeApplied Sciences · Kunsan National University · Daejeon University
  11. 2021
    An Efficient Class-incremental Learning Strategy with Frozen Weights and Pseudo ExemplarsBeen-Chian Chien, Yueh-Chia Hsu, Tzung‐Pei HongThe 8th Multidisciplinary International Social Networks C… · National University of Tainan · National Sun Yat-sen University · +1
  12. 2021
    Deep Rapid Class Augmentation; A New Progressive Learning Approach that Eliminates the Issue of Catastrophic ForgettingHanna WitzgallAdvances in intelligent systems and computing · Leidos (United States)
  13. 2021
    Kronecker Factorization for Preventing Catastrophic Forgetting in Large-scale Medical Entity LinkingDenis Jered McInerney, Luyang Kong, Kristjan Arumae … Parminder BhatiaarXiv · Universidad del Noreste · Amazon (Germany)
    PDF ↗
  14. 2021
    A biologically inspired architecture with switching units can learn to generalize across backgroundsDoris Voina, Eric Shea‐Brown, Ştefan MihalaşbioRxiv · University of Washington · University of Washington Applied Physics Laboratory · +2
  15. 2021
    Secure and efficient parameters aggregation protocol for federated incremental learning and its applicationsXiaoying Wang, Zhiwei Liang, Arthur Sandor Voundi Koe … Qintai YangInternational Journal of Intelligent Systems · Sun Yat-sen University · Third Affiliated Hospital of Sun Yat-sen University · +1
  16. 2021
    Reactive Multi-Fitness Learning for Robust Multiagent TeamingConnor Yates, Ayhan Alp Aydeniz, Kagan TumerInternational Symposium on Multi-Robot and Multi-Agent Sy… · Oregon State University
  17. 2021PDF ↗
  18. 2021
    One Pass ImageNetHuiyi Hu, Ang Li, Daniele Calandriello, Dilan GörürarXiv
    PDF ↗
  19. 2021
    A Meta-Learned Neuron model for Continual LearningRodrigue SiryarXiv · Normandie Université · Université de Caen Normandie
    PDF ↗
  20. 2021
    Continual learning classification method with single-label memory cells based on the intelligent mechanism of the biological immune systemDong Li, Lanlan Gong, Shulin Liu … Kun QianJournal of Intelligent & Fuzzy Systems · Changzhou University · Shanghai University
  21. 2021
    Incremental Learning of Object Detector with Limited Training DataMuhammad Abdullah Hafeez, Adnan Ul-Hasan, Faisal ShafaitDigital Image Computing: Techniques and Applications (DICTA) · Abdus Salam Centre for Physics · National University of Sciences and Technology
  22. 2021
    Mitigating Catastrophic Forgetting in Deep Learning in a Streaming Setting Using Historical SummarySajal Dash, Junqi Yin, Mallikarjun Shankar … Wu-chun FengInternational Workshop on Data Analysis and Reduction for… · Oak Ridge National Laboratory · Naval Research Laboratory Information Technology Division · +1
  23. 2021
    Possibi¬lities of Using Neural Network Incremental LearningElena S. Abramova, Alexey Orlov, K. V. MakarovBulletin of the South Ural State University Ser Computer…
  24. 2021
    Incremental Feature Learning Using Constructive Neural NetworksArmin Sadreddin, Samira SadaouiIEEE 33rd International Conference on Tools with Artifici… · University of Regina
  25. 2021
    Novelty detection for unsupervised continual learning in image sequencesRuiqi Dai, Mathieu Lefort, Frédéric Armetta … Stefan DuffnerIEEE 33rd International Conference on Tools with Artifici… · Lyon 1 Université · Centre National de la Recherche Scientifique · +3
  26. 2021
    A Novel Class-wise Forgetting Detector in Continual LearningXuan Cuong Pham, Alan Wee‐Chung Liew, Can WangDigital Image Computing: Techniques and Applications (DICTA) · Griffith University
  27. 2021
    Reducing catastrophic forgetting problem in streaming data by Hybrid Shark Smell with Jaya Optimization-based Deep Neural NetworksMaisnam Niranjan Singh, Samitha KhaiyumAdvances in Complex Systems · Dr. Hari Singh Gour University
  28. 2021
    Variance Guided Continual Learning in a Convolutional Neural Network Gaussian Process Single Classifier Approach for Multiple Tasks in Noisy ImagesMahed Javed, Lyudmila Mihaylova, Nidhal BouaynayaInformation Fusion · University of Sheffield · Rowan University
    PDF ↗
  29. 2021
    Task Ordering Matters for Incremental LearningZhaonan Yang, Huiyun LiInternational Symposium on Networks, Computers and Commun… · Shenzhen Institutes of Advanced Technology · University of Chinese Academy of Sciences · +1
  30. 2021
    Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat MinimaGuangyuan Shi, Jiaxin Chen, Wenlong Zhang … Xiao-Ming WuNeurIPS · Hong Kong Polytechnic University
    PDF ↗
  31. 2021
    Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object DetectionNa Dong, Yongqiang Zhang, Mingli Ding, Gim Hee LeeNeurIPS · Harbin Institute of Technology · National University of Singapore
    PDF ↗
  32. 2021
    Learning where to learn: Gradient sparsity in meta and continual learningJohannes von Oswald, Dominic Zhao, Seijin Kobayashi … João SacramentoNeurIPS
    PDF ↗
  33. 2021
    Provable Lifelong Learning of RepresentationsXinyuan Cao, Weiyang Liu, Santosh VempalaAISTATS · Georgia Institute of Technology · University of Cambridge
    PDF ↗
  34. 2021
    Structure Aware Experience Replay for Incremental Learning in Graph-based Recommender SystemsKian Ahrabian, Yishi Xu, Yingxue Zhang … Mark CoatesACM International Conference on Information & Knowled… · McGill University · Huawei Technologies (Canada)
  35. 2021
    Going Beyond the Point Neuron: Active Dendrites and Sparse Representations for Continual LearningKaran Grewal, Jérémy Forest, Benjamin P. Cohen, Subutai AhmadbioRxiv · Numerica Corporation (United States) · Lumentum (United States)
  36. 2021PDF ↗
  37. 2021PDF ↗
  38. 2021
    Exploring System Performance of Continual Learning for Mobile and Embedded Sensing ApplicationsYoung D. Kwon, Jagmohan Chauhan, Abhishek Kumar … Cecilia MascoloTyöväentutkimus Vuosikirja · University of Cambridge · University of Southampton
    PDF ↗
  39. 2021
    Mixture-of-Variational-Experts for Continual LearningHeinke Hihn, Daniel BraunarXiv · Universität Ulm
    PDF ↗
  40. 2021
    AFEC: Active Forgetting of Negative Transfer in Continual LearningLiyuan Wang, Ming‐Tian Zhang, Zhongfan Jia … Yi ZhongNeurIPS · Tsinghua University · University College London
    PDF ↗
  41. 2021
    Wide Neural Networks Forget Less CatastrophicallySeyed Iman Mirzadeh, Arslan Chaudhry, Yin, Dong … Mehrdad FarajtabarICML · Google (United States)
    PDF ↗
  42. 2021
    Center Loss Regularization for Continual LearningKaustubh Olpadkar, Ekta GavasarXiv
    PDF ↗
  43. 2021
    Generalized Weight Agnostic Neural Networks for Configurable and Continual Autonomous SystemsPranav Gadikar, Vinod Ganesan, Pratyush Kumar PandaThe First International Conference on AI-ML-Systems · Indian Institute of Technology Madras · Microsoft Research (India)
  44. 2021
    A Biologically Plausible Model for Continual Learning using Synaptic Weight AttractorsRomik Ghosh, D. Mastrovito, Ştefan MihalaşbioRxiv · Ohio University · Allen Institute · +3
  45. 2021
    A TinyML Platform for On-Device Continual Learning With Quantized Latent ReplaysLeonardo Ravaglia, Manuele Rusci, Davide Nadalini … Luca BeniniIEEE Journal on Emerging and Selected Topics in Circuits… · University of Bologna · University of Modena and Reggio Emilia · +1
    PDF ↗
  46. 2021
    Continual Learning in Multilingual NMT via Language-Specific EmbeddingsAlexandre BérardConference on Machine Translation
    PDF ↗
  47. 2021
    Coordinating Experience Replay: A Harmonious Experience Retention approach for Continual LearningZhong Ji, Jiayi Liu, Qiang Wang, Zhongfei ZhangKnowledge-Based Systems · Tianjin University · State Key Laboratory on Integrated Optoelectronics · +1
  48. 2021
    Behavioral Experiments for Understanding Catastrophic ForgettingSamuel J. Bell, Neil D. LawrencearXiv · University of Cambridge
    PDF ↗
  49. 2021
    Class Incremental Online Streaming LearningSoumya Banerjee, Vinay Kumar Verma, Toufiq Parag … Vinay P. NamboodiriarXiv · Indian Institute of Technology Kanpur · Duke University · +1
    PDF ↗
  50. 2021
    Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime InferenceHyunseo Koh, Dahyun Kim, Jung-Woo Ha, Jonghyun ChoiICLR · Gwangju Institute of Science and Technology
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.