Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

637 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2020
    Simple Lifelong Learning MachinesJoshua T. Vogelstein, Jayanta Dey, Hayden S. Helm … Carey E. PriebeTPAMI · Johns Hopkins University · Baylor College of Medicine · +1
    PDF ↗
  2. 2020
    Hidden Markov Neural NetworksLorenzo Rimella, Nick WhiteleyEntropy · Collegio Carlo Alberto · University of Turin · +1
    PDF ↗
  3. 2020
    A Layered Learning Approach to Scaling in Learning Classifier Systems for Boolean ProblemsIsidro M. Alvarez, Trung B. Nguyen, Will N. Browne, Mengjie ZhangEvolutionary Computation · Victoria University of Wellington · Statistics New Zealand · +1
    PDF ↗
  4. 2020
    A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World LearningMartin Mundt, Yongwon Hong, Iuliia Pliushch, Visvanathan RameshNeural Networks · Goethe University Frankfurt · Technische Universität Darmstadt · +1
    PDF ↗
  5. 2020
    Overcoming Catastrophic Forgetting via Direction-Constrained OptimizationYunfei Teng, Anna Choromanska, Murray Campbell … Lior HoreshSpringer LNCS · New York University
    PDF ↗
  6. 2020
    Explainable Goal-driven Agents and Robots - A Comprehensive ReviewSado Fatai, Chu Kiong Loo, Wei Shiung Liew … Stefan WermterACM Computing Surveys · University of Malaya · Universität Hamburg
    PDF ↗
  7. 2020
    Class-Incremental Learning: Survey and Performance Evaluation on Image ClassificationMarc Masana, Xialei Liu, Bartłomiej Twardowski … Joost van de WeijerTPAMI · Computer Vision Center
    PDF ↗
  8. 2020
    Lifelong Graph LearningChen Wang, Yuheng Qiu, Dasong Gao, Sebastian SchererCVPR · Carnegie Mellon University
    PDF ↗
  9. 2020
    Incremental Few-Shot Object Detection for RoboticsYiting Li, Haiyue Zhu, Sichao Tian … Tong Heng LeeICRA · National University of Singapore · Agency for Science, Technology and Research · +2
    PDF ↗
  10. 2020
    Instance exploitation for learning temporary concepts from sparsely labeled drifting data streamsŁukasz Korycki, Bartosz KrawczykPattern Recognition · Virginia Commonwealth University
    PDF ↗
  11. 2020
    An Incremental Learning Approach Using Long Short-Term Memory Neural NetworksÁlvaro C. Lemos Neto, Rodrigo A. Coelho, Cristiano Leite de CastroJournal of Control Automation and Electrical Systems · Universidade Federal de Minas Gerais
  12. 2020
    Instance Weighted Incremental Evolution Strategies for Reinforcement Learning in Dynamic EnvironmentsZhi Wang, Chunlin Chen, Daoyi DongTNNLS · University of Canberra · UNSW Sydney · +1
    PDF ↗
  13. 2020
    Self-Training for Class-Incremental Semantic SegmentationLu Yu, Xialei Liu, Joost van de WeijerTNNLS · Tianjin University of Technology · Nankai University · +1
    PDF ↗
  14. 2020
    Sequential changepoint detection in neural networks with checkpointsMichalis K. Titsias, Jakub Sygnowski, Yutian ChenStatistics and Computing · Google DeepMind (United Kingdom)
    PDF ↗
  15. 2020
    Mind Your Manners! A Dataset and a Continual Learning Approach for Assessing Social Appropriateness of Robot ActionsJonas Tjomsland, Sinan Kalkan, Hatice GüneşFrontiers · University of Cambridge · Middle East Technical University
    PDF ↗
  16. 2020
    Efficient Architecture Search for Continual LearningQiang Gao, Zhipeng Luo, Diego Klabjan, Fengli ZhangTNNLS · Southwestern University of Finance and Economics · Northwestern University · +1
    PDF ↗
  17. 2020
    Brain-inspired global-local learning incorporated with neuromorphic computingYujie Wu, Rong Zhao, Jun Zhu … Luping ShiNature Communications · Tsinghua University · Chinese Institute for Brain Research · +1
    PDF ↗
  18. 2020
    Drinking From a Firehose: Continual Learning With Web-Scale Natural LanguageHexiang Hu, Ozan Şener, Fei Sha, Vladlen KoltunTPAMI · University of Southern California · Intel (United States)
    PDF ↗
  19. 2020
    Knowledge Capture and Replay for Continual LearningSaisubramaniam Gopalakrishnan, Pranshu Ranjan Singh, Haytham M. Fayek … ArulMurugan AmbikapathiWACV · Agency for Science, Technology and Research · Institute for Infocomm Research · +1
    PDF ↗
  20. 2020
    Modular-Relatedness for Continual LearningAmmar Shaker, Francesco Alesiani, Shujian YuSpringer LNCS · UiT The Arctic University of Norway
    PDF ↗
  21. 2020
    Incremental Learning for End-to-End Automatic Speech RecognitionLi Fu, Xiaoxiao Li, Libo Zi … Bowen ZhouIEEE Automatic Speech Recognition and Understanding Works… · Jingdong (China)
    PDF ↗
  22. 2020
    MgSvF: Multi-Grained Slow versus Fast Framework for Few-Shot Class-Incremental LearningHanbin Zhao, Yongjian Fu, Mintong Kang … Xi LiTPAMI · Zhejiang University of Science and Technology · Huawei Technologies (China)
    PDF ↗
  23. 2020
    CVPR 2020 Continual Learning in Computer Vision Competition: Approaches, Results, Current Challenges and Future DirectionsVincenzo Lomonaco, Lorenzo Pellegrini, Pau Rodríguez … Davide MaltoniArtificial Intelligence · University of Bologna · Mila - Quebec Artificial Intelligence Institute · +7
    PDF ↗
  24. 2020
    AILearn: An Adaptive Incremental Learning Model for Spoof Fingerprint DetectionShivang Agarwal, Ajita Rattani, C. Ravindranath ChowdaryMachine Learning with Applications · Indian Institute of Technology BHU · Banaras Hindu University · +1
    PDF ↗
  25. 2020
    Incremental Object Detection via Meta-LearningK J Joseph, Jathushan Rajasegaran, Salman Khan … Vineeth N BalasubramanianTPAMI · Indian Institute of Technology Hyderabad · Mohamed bin Zayed University of Artificial Intelligence
    PDF ↗
  26. 2020PDF ↗
  27. 2020
    SS-IL: Separated Softmax for Incremental LearningHongjoon Ahn, Jihwan Kwak, Subin Lim … Taesup MoonICCV · Sungkyunkwan University · Seoul National University
    PDF ↗
  28. 2020
    Triple-Memory Networks: A Brain-Inspired Method for Continual LearningLiyuan Wang, Bo Lei, Qian Li … Yi ZhongTNNLS · Chinese Institute for Brain Research · Center for Life Sciences · +1
    PDF ↗
  29. 2020
    Sense and Learn: Self-Supervision for Omnipresent SensorsAaqib Saeed, Victor Ungureanu, Beat GfellerMachine Learning with Applications · Eindhoven University of Technology · Google (Switzerland)
    PDF ↗
  30. 2020
    S2OSC: A Holistic Semi-Supervised Approach for Open Set ClassificationYang Yang, Hongchen Wei, Zhenqiang Sun … Jian YangACM Transactions · Nanjing University of Science and Technology · Nanjing Normal University · +3
    PDF ↗
  31. 2020
    Task-Agnostic Continual Learning Using Online Variational Bayes With Fixed-Point UpdatesChen Zeno, Itay Golan, Elad Hoffer, Daniel SoudryNeural Computation · Technion – Israel Institute of Technology · Itamar Medical (Israel)
    PDF ↗
  32. 2020
    Exploring DeshuffleGANs in Self-Supervised Generative Adversarial NetworksGulcin Baykal, Furkan Özçelik, Gözde ÜnalPattern Recognition · Istanbul Technical University
    PDF ↗
  33. 2020
    Lambda Learner: Fast Incremental Learning on Data StreamsRohan Ramanath, Konstantin Salomatin, Jeffrey D. Gee … Deepak KumarKDD · LinkedIn (United States)
    PDF ↗
  34. 2020
    The State of Lifelong Learning in Service Robots:Hamidreza Kasaei, Jorik Melsen, Floris van Beers … Klemen VoncinaJournal of Intelligent & Robotic Systems · University of Groningen
    PDF ↗
  35. 2020
    Lifelong Learning of Graph Neural Networks for Open-World Node ClassificationLukas Galke, Benedikt Franke, Tobias Zielke, Ansgar ScherpIEEE International Joint Conference on Neural Network · Christian-Albrechts-Universität zu Kiel
    PDF ↗
  36. 2020
    Generative Feature Replay with Orthogonal Weight Modification for Continual LearningGehui Shen, Song Zhang, Xiang Chen, Zhihong DengIJCNN · Peking University
    PDF ↗
  37. 2020
    Bilevel Continual LearningAmmar Shaker, Francesco Alesiani, Shujian Yu, Wenzhe YinIJCNN · Heidelberg University
    PDF ↗
  38. 2020
    BinPlay: A Binary Latent Autoencoder for Generative Replay Continual LearningKamil Rafał Deja, Paweł Wawrzyński, Daniel Marczak … T. P. TrzcinskiIEEE International Joint Conference on Neural Network · Warsaw University of Technology
    PDF ↗
  39. 2020
    A Biologically Plausible Audio-Visual Integration Model for Continual LearningWenjie Chen, Fengtong Du, Ye Wang, Lihong CaoIJCNN · Communication University of China
    PDF ↗
  40. 2020
    FoCL: Feature-Oriented Continual Learning for Generative ModelsQicheng Lao, Mehrzad Mortazavi, Marzieh S. Tahaei … Mohammad HavaeiPattern Recognition · Sichuan University · West China Medical Center of Sichuan University · +3
    PDF ↗
  41. 2020
    Artificial Neural Variability for Deep Learning: On Overfitting, Noise Memorization, and Catastrophic ForgettingZeke Xie, Fengxiang He, Shaopeng Fu … Masashi SugiyamaNeural Computation · RIKEN Center for Advanced Intelligence Project · The University of Tokyo · +1
    PDF ↗
  42. 2020
    PANDA: Adapting Pretrained Features for Anomaly Detection and SegmentationTal Reiss, Niv Cohen, Liron Bergman, Yedid HoshenCVPR · Hebrew University of Jerusalem
    PDF ↗
  43. 2020
    PLOP: Learning without Forgetting for Continual Semantic SegmentationArthur Douillard, Yifu Chen, Arnaud Dapogny, Matthieu CordCVPR · Sorbonne Université · Laboratoire Médiations · +1
    PDF ↗
  44. 2020
    Adaptive Aggregation Networks for Class-Incremental LearningYaoyao Liu, Bernt Schiele, Qianru SunCVPR · Max Planck Institute for Informatics · Singapore Management University
    PDF ↗
  45. 2020
    Continual Adaptation of Visual Representations via Domain Randomization and Meta-learningRiccardo Volpi, Diane Larlus, Grégory RogezCVPR · Naver (South Korea)
    PDF ↗
  46. 2020
    IIRC: Incremental Implicitly-Refined ClassificationMohamed Abdelsalam, Mojtaba Faramarzi, Shagun Sodhani, Sarath ChandarCVPR · Mila - Quebec Artificial Intelligence Institute · Université de Montréal · +3
    PDF ↗
  47. 2020
    KSM: Fast Multiple Task Adaption via Kernel-wise Soft Mask LearningLi Yang, Zhezhi He, Junshan Zhang, Deliang FanCVPR · Arizona State University
    PDF ↗
  48. 2020
    Insights from the Future for Continual LearningArthur Douillard, Eduardo Valle, Charles Ollion … Matthieu CordCVPR · Sorbonne Université · Universidade Estadual de Campinas (UNICAMP)
    PDF ↗
  49. 2020
    Continual Model-Based Reinforcement Learning with HypernetworksYizhou Huang, Kevin Xie, Homanga Bharadhwaj, Florian ShkurtiICRA · University of Toronto
    PDF ↗
  50. 2020
    SID: Incremental Learning for Anchor-Free Object Detection via Selective and Inter-Related DistillationCan Peng, Kun Zhao, Sam Maksoud … Brian C. LovellComputer Vision and Image Understanding · The University of Queensland
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.