Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

615 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2021
    Recent Advances of Continual Learning in Computer Vision: An OverviewHaoxuan Qu, Hossein Rahmani, Li Xu … Jun LiuIET Computer Vision · Lancaster University · Singapore University of Technology and Design
    PDF ↗
  2. 2021
    Continual Learning With Quasi-Newton MethodsSteven Vander Eeckt, Hugo Van hammeIEEE Access · KU Leuven
    PDF ↗
  3. 2021
    Continual Developmental Neurosimulation Using Embodied Computational AgentsBradly Alicea, Rishabh Chakrabarty, Stefan Dvoretskii … Joane ParentIOP Conference Series Materials Science and Engineering · University of Illinois Urbana-Champaign · Urbana University · +3
    PDF ↗
  4. 2021
    Generative feature-driven image replay for continual learningKevin Thandiackal, Tiziano Portenier, Andrea Giovannini … Orçun GökselImage and Vision Computing · ETH Zurich · IBM Research - Zurich · +1
    PDF ↗
  5. 2021
    Simultaneous Multi-View Object Recognition and Grasping in Open-Ended DomainsHamidreza Kasaei, Mohammadreza Kasaei, Georgios Tziafas … Remo SassoJournal of Intelligent & Robotic Systems · University of Groningen · University of Edinburgh
    PDF ↗
  6. 2021
    Task-Specific Normalization for Continual Learning of Blind Image Quality ModelsWeixia Zhang, Kede Ma, Guangtao Zhai, Xiaokang YangTIP · Shanghai Jiao Tong University · City University of Hong Kong · +1
    PDF ↗
  7. 2021
    Relational Experience Replay: Continual Learning by Adaptively Tuning Task-Wise RelationshipQuanziang Wang, Renzhen Wang, Yuexiang Li … Deyu MengIEEE Trans. Multimedia · Xi'an Jiaotong University · Tencent (China) · +1
    PDF ↗
  8. 2021
    Tuned Compositional Feature Replays for Efficient Stream LearningMorgan B. Talbot, Rushikesh Zawar, Rohil Badkundri … Gabriel KreimanTNNLS · Boston Children's Hospital · Harvard–MIT Division of Health Sciences and Technology · +6
    PDF ↗
  9. 2021
    Continual Learning: Fast and SlowQuang Pham, Chenghao Liu, Steven C. H. HoiTPAMI · Institute for Infocomm Research · Singapore Management University
    PDF ↗
  10. 2021
    Continual Learning of Generative Models With Limited Data: From Wasserstein-1 Barycenter to Adaptive CoalescenceMehmet Dedeoğlu, Sen Lin, Zhaofeng Zhang, Junshan ZhangTNNLS · Arizona State University · The Ohio State University · +1
    PDF ↗
  11. 2021
    Prototype-Guided Memory Replay for Continual LearningStella Ho, Ming Liu, Lan Du … Yong XiangTNNLS · Deakin University · Monash University · +1
    PDF ↗
  12. 2021
    RMM: Reinforced Memory Management for Class-Incremental LearningYaoyao Liu, Bernt Schiele, Qianru SunNeurIPS
    PDF ↗
  13. 2021
    Latent-Insensitive Autoencoders for Anomaly Detection and Class-Incremental LearningMuhammad S. Battikh, Artem LenskiyMathematics · Al-Azhar University · Australian National University
    PDF ↗
  14. 2021
    Continual Deep Learning through Unforgettable Past Practical ConvolutionMuhammad Rehan Naeem, Muhammad Munwar Iqbal, Rashid AminJournal of Information Communication Technologies and Rob…
  15. 2021
    An Incremental Learning Model for Mobile Robot: From Short-Term Memory to Long-Term MemoryDongshu Wang, Kai Yang, Lei Liu, Heshan WangIEEE TAI · Zhengzhou University · China Mobile (China) · +1
  16. 2021PDF ↗
  17. 2021
    Embodied Learning for Lifelong Visual PerceptionDavid Nilsson, Aleksis Pirinen, Erik Gärtner, Cristian SminchisescuarXiv
    PDF ↗
  18. 2021
    Generative Kernel Continual learningMohammad Mahdi Derakhshani, Xiantong Zhen, Ling Shao, Cees G. M. SnoekarXiv
    PDF ↗
  19. 2021
    DILF-EN framework for Class-Incremental LearningMohammed Asad Karim, Indu Joshi, Pratik Mazumder, Pravendra SingharXiv
    PDF ↗
  20. 2021
  21. 2021
    How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?Dong, Xinhsuai, Tuan, Luu Anh, Min Lin … Hanwang ZhangNeurIPS
    PDF ↗
  22. 2021
    Modular Dynamic Neural Network: A Continual Learning ArchitectureDaniel Z. Turner, Pedro J. S. Cardoso, João M. F. RodriguesApplied Sciences · University of Algarve
  23. 2021
    Toward durable representations for continual learningAlaa El Khatib, Fakhri KarrayAdvances in Computational Intelligence · University of Waterloo
  24. 2021PDF ↗
  25. 2021
    Imbal-OL: Online Machine Learning from Imbalanced Data Streams in Real-world IoTBharath Sudharsan, John G. Breslin, Muhammad Intizar AliIEEE International Conference on Big Data (Big Data) · Ollscoil na Gaillimhe – University of Galway · Dublin City University
  26. 2021
    Continual Neural Network Model RetrainingXiaofeng Zhu, Diego KlabjanIEEE International Conference on Big Data (Big Data) · Microsoft (United States) · Northwestern University
  27. 2021PDF ↗
  28. 2021
    Modeling nuisance classifier towards class-incremental learning of crowd-sourced dataRamesh Ashok Tabib, T. Santoshkumar, Dikshit Hegde … Uma MudenagudiTwelfth Indian Conference on Computer Vision, Graphics an… · KLE Technological University
  29. 2021
    Incremental Learning for End-to-End Automatic Speech RecognitionLi Fu, Xiaoxiao Li, Libo Zi … Bowen ZhouIEEE Automatic Speech Recognition and Understanding Works… · Jingdong (China)
    PDF ↗
  30. 2021
    Improving Vision Transformers for Incremental LearningPei Yu, Yinpeng Chen, Ying Jin, Zicheng LiuarXiv
    PDF ↗
  31. 2021PDF ↗
  32. 2021
    Gradient-matching coresets for continual learningLukas Balles, Giovanni Zappella, Cédric ArchambeauarXiv
    PDF ↗
  33. 2021
    Cost-Effective Incremental Deep Model: Matching Model Capacity With the Least SamplingYang Yang, Da-Wei Zhou, De-Chuan Zhan … Jian YangTKDE · Nanjing University of Science and Technology · Southeast University · +2
  34. 2021PDF ↗
  35. 2021
    Continual Learning for Sentiment Classification by Iterative Networks CombinationShupeng Wang, Junhao LiuInternational Conference on Computer Science and Artifici… · University of Science and Technology of China · Shenzhen Institutes of Advanced Technology
  36. 2021
    Overcome Anterograde Forgetting with Cycled Memory NetworksJian Peng, Dingqi Ye, Bo Tang … Haifeng LiarXiv
    PDF ↗
  37. 2021PDF ↗
  38. 2021
    Meta-learning synaptic plasticity and memory addressing for continual familiarity detectionDanil Tyulmankov, Guangyu Robert Yang, L. F. AbbottNeuron · Columbia University · Allen Institute for Brain Science · +1
  39. 2021
    Continual Learning for Multivariate Time Series Tasks with Variable Input DimensionsVibhor Gupta, Jyoti Narwariya, Pankaj Malhotra … Gautam ShroffICDM
    PDF ↗
  40. 2021
    Few-Shot Class-Incremental Learning with Meta-Learned Class StructuresGuangtao Zheng, Aidong ZhangICDM · University of Virginia
  41. 2021
    Evaluating and Explaining Generative Adversarial Networks for Continual Learning under Concept DriftFilip Guzy, Michał Woźniak, Bartosz KrawczykICDM · University of Science and Technology · AGH University of Krakow · +1
  42. 2021
    EXPANSE, A Continual Deep Learning System; Research ProposalMohammadreza Iman, Khaled Rasheed, Hamid R. ArabniaInternational Conference on Computational Science and Com… · University of Georgia · Franklin College
  43. 2021
    Two-Branch Attention Learning for Fine-Grained Class Incremental LearningJiaqi Guo, Guanqiu Qi, Xie Shuiqing, Xiangyuan LiElectronics · South Central Minzu University · Buffalo State University · +1
  44. 2021
    Conflicts between Likelihood and Knowledge Distillation in Task Incremental Learning for 3D Object DetectionYun Peng, Jun Cen, Ming LiuInternational Conference on 3D Vision (3DV) · Hong Kong University of Science and Technology
  45. 2021
    Structural Knowledge Organization and Transfer for Class-Incremental LearningYu Liu, Xiaopeng Hong, Xiaoyu Tao … Yihong GongACM MM · Xi'an Jiaotong University
  46. 2021
    Double distillation for class incremental learningDarian M. Onchiş, Ioan-Valentin SamuilaInternational Symposium on Symbolic and Numeric Algorithm… · West University of Timişoara
  47. 2021
    Impact Patterns of Combining Model Pruning and Continual Learning on Model PerformanceXueyang Zhang, Hang Li, Xi Chen, Xue LiuIEEE Third International Conference on Cognitive Machine… · McGill University
  48. 2021
    SGDOL: Self-evolving Generative and Discriminative Online Learning for Data Stream ClassificationDeeksha Aggarwal, J. Senthilnath, Uttam Kumar … Xiaoli LiICDM · International Institute of Information Technology Bangalore · Agency for Science, Technology and Research · +2
  49. 2021
    Large-scale deep class-incremental learning. (Apprentissage incrémental profond à large échelle)Eden BelouadahEcole nationale supérieure Mines-Télécom Atlantique Breta… · IMT Atlantique
  50. 2021
    The Role Weights Play in Catastrophic ForgettingArend HintzeInternational Conference on Soft Computing & Machine… · Dalarna University
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.