Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

301 papers of 8,653 · showing 151–200Sort Recent · Most cited
  1. 2020
    Lifelong Machine Learning with Deep Streaming Linear Discriminant AnalysisTyler L. Hayes, Christopher KananCVPR · Rochester Institute of Technology
    PDF ↗
  2. 2020
    iTAML: An Incremental Task-Agnostic Meta-learning ApproachJathushan Rajasegaran, Salman Khan, Munawar Hayat … Mubarak ShahCVPR · Inception Institute of Artificial Intelligence · Linköping University · +1
    PDF ↗
  3. 2020
    Continual Learning for Anomaly Detection in Surveillance VideosKeval Doshi, Yasin YılmazCVPR · University of South Florida
    PDF ↗
  4. 2020
    Learning to Segment the TailXinting Hu, Yi Jiang, Kaihua Tang … Hanwang ZhangCVPR · Nanyang Technological University · Alibaba Group (United States) · +1
    PDF ↗
  5. 2020
    Overcoming Multi-Model Forgetting in One-Shot NAS With Diversity MaximizationMiao Zhang, Huiqi Li, Shirui Pan … Steven W. SuCVPR · University of Technology Sydney · Beijing Institute of Technology · +2
  6. 2020
    Rehearsal-Free Continual Learning over Small Non-I.I.D. BatchesVincenzo Lomonaco, Davide Maltoni, Lorenzo PellegriniCVPR · University of Bologna
    PDF ↗
  7. 2020
    Continual Learning With Extended Kronecker-Factored Approximate CurvatureJanghyeon Lee, Hyeong Gwon Hong, Donggyu Joo, Junmo KimCVPR · Korea Advanced Institute of Science and Technology
    PDF ↗
  8. 2020
    Cognitively-Inspired Model for Incremental Learning Using a Few ExamplesAli Ayub, Alan R. WagnerCVPR · Pennsylvania State University
    PDF ↗
  9. 2020
    Dropout as an Implicit Gating Mechanism For Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Hassan GhasemzadehCVPR · Washington State University · Google (United States)
    PDF ↗
  10. 2020
    Generalized Class Incremental LearningFei Mi, Lingjing Kong, Tao Lin … Boi FaltingsCVPR · École Polytechnique Fédérale de Lausanne
  11. 2020
    Reducing catastrophic forgetting with learning on synthetic dataWojciech Masarczyk, Ivona TautkutėCVPR · Warsaw University of Technology · Institute of Theoretical and Applied Informatics · +3
    PDF ↗
  12. 2020
    Stream-51: Streaming Classification and Novelty Detection from VideosRyne Roady, Tyler L. Hayes, Hitesh Vaidya, Christopher KananCVPR · Rochester Institute of Technology
  13. 2020
    Unsupervised Model Personalization While Preserving Privacy and Scalability: An Open ProblemMatthias De Lange, Xu Jia, Sarah Parisot … Tinne TuytelaarsCVPR · KU Leuven · Huawei Technologies (Sweden)
    PDF ↗
  14. 2020
    Sequential Mastery of Multiple Visual Tasks: Networks Naturally Learn to Learn and Forget to ForgetGuy Davidson, Michael C. MozerCVPR · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +2
    PDF ↗
  15. 2020
    Relationship Matters: Relation Guided Knowledge Transfer for Incremental Learning of Object DetectorsKandan Ramakrishnan, Rameswar Panda, Quanfu Fan … Rogério FerisCVPR · IBM (United States)
  16. 2020
    IROS 2019 Lifelong Robotic Vision: Object Recognition Challenge [Competitions]Heechul Bae, Eoin Brophy, Rosa H. M. Chan … Liguang ZhouIEEE Robotics & Automation Magazine · Electronics and Telecommunications Research Institute · Dublin City University · +9
  17. 2020
    StackNet: Stacking feature maps for Continual learningKim Jangho, Jeesoo Kim, Nojun KwakCVPR · Seoul National University
    PDF ↗
  18. 2020
    A SiOx, RRAM-based hardware with spike frequency adaptation for power-saving continual learning in convolutional neural networksIrene Muñoz-Martín, S. Bianchi, Erika Covi … Daniele IelminiIEEE Symposium on VLSI Technology · Politecnico di Milano · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · +2
  19. 2020
    Noise-based Selection of Robust Inherited Model for Accurate Continual LearningXiaocong Du, Zheng Li, Jae-sun Seo … Yu CaoCVPR · Arizona State University · Oak Ridge National Laboratory
  20. 2020
    Generating Accurate Pseudo Examples for Continual LearningDaniel Silver, Sazia MahfuzCVPR · Acadia University
  21. 2020
    What is Happening Inside a Continual Learning Model? - A Representation-Based Evaluation of Representational Forgetting -Kengo Murata, Tetsuya Toyota, Kouzou OharaCVPR · Aoyama Gakuin University · Toho University
  22. 2020
    Continual Learning of Object InstancesKishan Parshotam, Mert KilickayaCVPR · University of Amsterdam
    PDF ↗
  23. 2020
    Quality metrics of variational autoencodersMikhail Leontev, Alexander Mikheev, Kirill Sviatov, Sergey SukhovInternational Conference on Information Technology and Na… · Kotelnikov Institute of Radioengineering and Electronics of the Russian Academy of Sciences · Ulyanovsk State Technical University
  24. 2020
    Progressive learning: A deep learning framework for continual learningHaytham M. Fayek, Lawrence Cavedon, Hong Ren WuNeural Networks · RMIT University
  25. 2020
    Progressive growing of self-organized hierarchical representations for explorationMayalen Etcheverry, Pierre‐Yves Oudeyer, Chris ReinkearXiv
    PDF ↗
  26. 2020
    Towards Knowledgeable Supervised Lifelong Learning SystemsDiana Benavides‐Prado, Yun Sing Koh, Patricia RiddleJournal of Artificial Intelligence Research · University of Auckland
  27. 2020
    Improving Performance in Reinforcement Learning by Breaking Generalization in Neural NetworksSina Ghiassian, Banafsheh Rafiee, Yat Long Lo, Adam WhiteAdaptive Agents and Multi-Agents Systems · University of Alberta
    PDF ↗
  28. 2020
    Visually Grounded Continual Learning of Compositional SemanticsXisen Jin, Junyi Du, Arka Sadhu … Xiang RenarXiv · University of Southern California · California Southern University
    PDF ↗
  29. 2020
    OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep LearningQi She, Fan Feng, Xinyue Hao … Rosa H. M. ChanICRA · City University of Hong Kong · Tsinghua University · +4
    PDF ↗
  30. 2020
    Sequential Presentation Protects Working Memory From Catastrophic InterferenceAnsgar D. Endress, Szilárd SzabóCognitive Science · City, University of London · Budapest University of Technology and Economics
  31. 2020
    Continual Learning with Bayesian Neural Networks for Non-Stationary DataRichard Kurle, Botond Cseke, Alexej Klushyn … Stephan GünnemannICLR
  32. 2020
    Bio-Inspired Techniques in a Fully Digital Approach for Lifelong LearningS. Bianchi, Irene Muñoz-Martín, Daniele IelminiFrontiers · Politecnico di Milano
  33. 2020
    Continual Deep Learning by Functional Regularisation of Memorable PastPingbo Pan, Siddharth Swaroop, Alexander Immer … Mohammad Emtiyaz KhanNeurIPS
    PDF ↗
  34. 2020
    Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual LearningZihan Liu, Genta Indra Winata, Andrea Madotto, Pascale FungarXiv · Hong Kong University of Science and Technology
    PDF ↗
  35. 2020
    Neural Network Retraining for Model ServingDiego Klabjan, Xiaofeng ZhuarXiv
    PDF ↗
  36. 2020
    Small-Task Incremental LearningArthur Douillard, M. Cord, Charles Ollion … E. ValleECCV
    PDF ↗
  37. 2020PDF ↗
  38. 2020
    Efficient Adaptation for End-to-End Vision-Based Robotic ManipulationRyan Julian, Benjamin Swanson, Gaurav S. Sukhatme … Karol HausmanRSS
    PDF ↗
  39. 2020
    Bayesian Nonparametric Weight Factorization for Continual LearningNikhil Mehta, Kevin J Liang, Vinay Kumar Verma, Lawrence CarinarXiv
    PDF ↗
  40. 2020
    Continual Reinforcement Learning with Multi-Timescale ReplayChristos Kaplanis, Claudia Clopath, Murray ShanahanarXiv · Imperial College London
    PDF ↗
  41. 2020
    Dark Experience for General Continual Learning: a Strong, Simple BaselinePietro Buzzega, Matteo Boschini, Angelo Porrello … Simone CalderaraNeurIPS · University of Modena and Reggio Emilia
    PDF ↗
  42. 2020
    Defining Benchmarks for Continual Few-Shot LearningAntreas Antoniou, Massimiliano Patacchiola, Mateusz Ochal, Amos StorkeyarXiv · University of Edinburgh
    PDF ↗
  43. 2020
    Incremental Learning of Object Models From Natural Human–Robot InteractionsPablo Azagra, Javier Civera, Ana C. MurilloIEEE Transactions · Universidad de Zaragoza · Instituto de Investigación en Ingeniería de Aragón
  44. 2020
    Self-Net: Lifelong Learning via Continual Self-ModelingJaya Krishna Mandivarapu, Blake Camp, Rolando EstradaFrontiers · Georgia State University
    PDF ↗
  45. 2020
    Continual Learning Through One-Class Classification Using VAEFelix Wiewel, Andreas Brendle, Bin YangICASSP · University of Stuttgart
  46. 2020
    Class-Agnostic Continual Learning of Alternating Languages and DomainsGermán Kruszewski, Ionut Sorodoc, Tomáš MikolovarXiv · Naver (South Korea) · Universitat Pompeu Fabra
    PDF ↗
  47. 2020
    Improved Pretraining for Domain-specific Contextual Embedding ModelsSubendhu Rongali, Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong YuarXiv · University of Massachusetts Amherst
    PDF ↗
  48. 2020
    Towards Making the Most of BERT in Neural Machine TranslationJiacheng Yang, Mingxuan Wang, Hao Zhou … Lei LiAAAI · Shanghai Jiao Tong University
    PDF ↗
  49. 2020
    Overcoming Catastrophic Forgetting by Neuron-level Plasticity ControlInyoung Paik, Sangjun Oh, Tae-Yeong Kwak, Injung KimAAAI · Handong Global University
    PDF ↗
  50. 2020
    Learning on the Job: Online Lifelong and Continual LearningBing LiuAAAI · University of Illinois Chicago
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.