Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

868 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2021
    Inexact bilevel stochastic gradient methods for constrained and unconstrained lower-level problemsTommaso Giovannelli, G. D. Kent, L. N. VicenteJournal of Global Optimization · University of Cincinnati · Lehigh University
    PDF ↗
  2. 2021
    Recent Advances of Continual Learning in Computer Vision: An OverviewHaoxuan Qu, Hossein Rahmani, Li Xu … Jun LiuIET Computer Vision · Lancaster University · Singapore University of Technology and Design
    PDF ↗
  3. 2021
    Continual Learning With Quasi-Newton MethodsSteven Vander Eeckt, Hugo Van hammeIEEE Access · KU Leuven
    PDF ↗
  4. 2021
    Continual Developmental Neurosimulation Using Embodied Computational AgentsBradly Alicea, Rishabh Chakrabarty, Stefan Dvoretskii … Joane ParentIOP Conference Series Materials Science and Engineering · University of Illinois Urbana-Champaign · Urbana University · +3
    PDF ↗
  5. 2021
    Backdoor learning curves: explaining backdoor poisoning beyond influence functionsAntonio Emanuele Ciná, Kathrin Grosse, Sebastiano Vascon … Marcello PelilloInternational Journal of Machine Learning and Cybernetics · University of Genoa · École Polytechnique Fédérale de Lausanne · +2
    PDF ↗
  6. 2021
    Generative feature-driven image replay for continual learningKevin Thandiackal, Tiziano Portenier, Andrea Giovannini … Orçun GökselImage and Vision Computing · ETH Zurich · IBM Research - Zurich · +1
    PDF ↗
  7. 2021
    Simultaneous Multi-View Object Recognition and Grasping in Open-Ended DomainsHamidreza Kasaei, Mohammadreza Kasaei, Georgios Tziafas … Remo SassoJournal of Intelligent & Robotic Systems · University of Groningen · University of Edinburgh
    PDF ↗
  8. 2021
    Task-Specific Normalization for Continual Learning of Blind Image Quality ModelsWeixia Zhang, Kede Ma, Guangtao Zhai, Xiaokang YangTIP · Shanghai Jiao Tong University · City University of Hong Kong · +1
    PDF ↗
  9. 2021
    Relational Experience Replay: Continual Learning by Adaptively Tuning Task-Wise RelationshipQuanziang Wang, Renzhen Wang, Yuexiang Li … Deyu MengIEEE Trans. Multimedia · Xi'an Jiaotong University · Tencent (China) · +1
    PDF ↗
  10. 2021
    Tuned Compositional Feature Replays for Efficient Stream LearningMorgan B. Talbot, Rushikesh Zawar, Rohil Badkundri … Gabriel KreimanTNNLS · Boston Children's Hospital · Harvard–MIT Division of Health Sciences and Technology · +6
    PDF ↗
  11. 2021
    Lifetime policy reuse and the importance of task capacityDavid M. Bossens, A.J. SobeyAI Communications · University of Southampton · Turing Institute · +1
    PDF ↗
  12. 2021
    Continual Learning: Fast and SlowQuang Pham, Chenghao Liu, Steven C. H. HoiTPAMI · Institute for Infocomm Research · Singapore Management University
    PDF ↗
  13. 2021
    Lifelong Vehicle Trajectory Prediction Framework Based on Generative ReplayPeng Bao, Zonghai Chen, Jikai Wang … Hao ZhaoIEEE T-ITS · University of Science and Technology of China
    PDF ↗
  14. 2021
    Cognitively Inspired Learning of Incremental Drifting ConceptsMohammad Rostami, Aram GalstyanIJCAI · University of Southern California · California Southern University
    PDF ↗
  15. 2021
    Lifelong learning on evolving graphs under the constraints of imbalanced classes and new classesLukas Galke, Iacopo Vagliano, Benedikt Franke … Ansgar ScherpNeural Networks · Max Planck Institute for Psycholinguistics · Amsterdam University Medical Centers · +3
    PDF ↗
  16. 2021
    PyCIL: a Python toolbox for class-incremental learningDa-Wei Zhou, Fuyun Wang, Han-Jia Ye, De‐Chuan ZhanInformation Sciences · Nanjing University
    PDF ↗
  17. 2021
    Incremental class learning using variational autoencoders with similarity learningJiahao Huo, Terence L. van ZylNeural Computing and Applications · University of Johannesburg
    PDF ↗
  18. 2021
    Continual Learning of Generative Models With Limited Data: From Wasserstein-1 Barycenter to Adaptive CoalescenceMehmet Dedeoğlu, Sen Lin, Zhaofeng Zhang, Junshan ZhangTNNLS · Arizona State University · The Ohio State University · +1
    PDF ↗
  19. 2021
    Prototype-Guided Memory Replay for Continual LearningStella Ho, Ming Liu, Lan Du … Yong XiangTNNLS · Deakin University · Monash University · +1
    PDF ↗
  20. 2021
    Multi-lingual agents through multi-headed neural networksJonathan D. Thomas, Ra ́ul Santos-Rodr ́ıguez, Mihai Anca, Robert J. PiechockiNorthern Lights Deep Learning Workshop · University of Bristol
    PDF ↗
  21. 2021
    Dataset Condensation with Distribution MatchingBo Zhao, Hakan BilenWACV · University of Edinburgh
    PDF ↗
  22. 2021
    Improving Gender Fairness of Pre-Trained Language Models without Catastrophic ForgettingZahra Fatemi, Xing Chen, Wenhao Liu, Caimming XiongACL · University of Illinois Chicago · University of Chicago · +1
    PDF ↗
  23. 2021
    Saliency Guided Experience Packing for Replay in Continual LearningGobinda Saha, Kaushik RoyWACV · Purdue University West Lafayette
    PDF ↗
  24. 2021
    A Broad Ensemble Learning System for Drifting Stream ClassificationSepehr Bakhshi, Pouya Ghahramanian, Hamed Bonab, Fazlı CanIEEE Access · Bilkent University · Amherst College
    PDF ↗
  25. 2021
    YANMTT: Yet Another Neural Machine Translation ToolkitRaj Dabre, Diptesh Kanojia, Chinmay Sawant, Eiichiro SumitaACL · Surrey Place Centre · National Institute of Information and Communications Technology · +1
    PDF ↗
  26. 2021
    Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse NetworksGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiySpringer LNCS · Eindhoven University of Technology · University of Twente
    PDF ↗
  27. 2021PDF ↗
  28. 2021
    Generalising via Meta-Examples for Continual Learning in the WildAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniSpringer LNCS · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  29. 2021
    Self-Activating Neural Ensembles for Continual Reinforcement LearningSam Powers, Xing, Eliot, Gupta, AbhinavCoLLAs · Carnegie Mellon University · Meta (Israel)
    PDF ↗
  30. 2021
    Complementary Calibration: Boosting General Continual Learning With Collaborative Distillation and Self-SupervisionZhong Ji, Jin Li, Qiang Wang, Zhongfei ZhangTIP · Tianjin University · Binghamton University
    PDF ↗
  31. 2021
    Multi-Label Classification via Adaptive Resonance Theory-Based ClusteringNaoki Masuyama, Yusuke Nojima, Chu Kiong Loo, Hisao IshibuchiTPAMI · Osaka Metropolitan University · University of Malaya · +1
    PDF ↗
  32. 2021
    DIODE: Dilatable Incremental Object DetectionCan Peng, Kun Zhao, Sam Maksoud … Brian C. LovellPattern Recognition · The University of Queensland
    PDF ↗
  33. 2021
    The geometry of representational drift in natural and artificial neural networksKyle Aitken, Marina Garrett, Shawn R. Olsen, Ştefan MihalaşPLOS · Allen Institute
  34. 2021
    Incremental Cluster Validity Index-Guided Online Learning for Performance and Robustness to Presentation OrderLeonardo Enzo Brito da Silva, Nagasharath Rayapati, Donald C. WunschTNNLS · Missouri University of Science and Technology
    PDF ↗
  35. 2021
    An analytical theory of curriculum learning in teacher–student networksLuca Saglietti, Stefano Sarao Mannelli, Andrew SaxeJournal of Statistical Mechanics Theory and Experiment · Bocconi University · Gatsby Computational Neuroscience Unit · +1
    PDF ↗
  36. 2021
    Balanced Softmax Cross-Entropy for Incremental LearningQuentin Jodelet, Xin Liu, Tsuyoshi MurataComputer Vision and Image Understanding · Tokyo Institute of Technology · National Institute of Advanced Industrial Science and Technology
    PDF ↗
  37. 2021
    Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A SurveyDanielle SaundersJournal of Artificial Intelligence Research · South Bend Museum of Art
    PDF ↗
  38. 2021
    TaskDrop: A Competitive Baseline for Continual Learning of Sentiment ClassificationJian-Ping Mei, Yilun Zhen, Qianwei Zhou, Rui YanNeural Networks · Zhejiang University of Science and Technology · Zhejiang University of Technology
    PDF ↗
  39. 2021
    Continuous learning of spiking networks trained with local rulesDmitry Antonov, Kirill Sviatov, Sergey SukhovNeural Networks · Kotelnikov Institute of Radioengineering and Electronics of the Russian Academy of Sciences · Ulyanovsk State Technical University
    PDF ↗
  40. 2021
    Online Lifelong Generalized Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramNeural Networks · Agency for Science, Technology and Research · Institute for Infocomm Research · +2
    PDF ↗
  41. 2021
    Continual Adaptation of Semantic Segmentation Using Complementary 2D-3D Data RepresentationsJonas Frey, Hermann Blum, Francesco Milano … César CadenaRA-L · ETH Zurich
    PDF ↗
  42. 2021
    The Surprising Positive Knowledge Transfer in Continual 3D Object Shape ReconstructionAnh Thai, Stefan Stojanov, Zixuan Huang, James M. RehgInternational Conference on 3D Vision (3DV) · Georgia Institute of Technology
    PDF ↗
  43. 2021
    Continual Learning for Monolingual End-to-End Automatic Speech RecognitionSteven Vander Eeckt, Hugo Van hammeEuropean Signal Processing Conference (EUSIPCO) · KU Leuven
    PDF ↗
  44. 2021
    Reminding the incremental language model via data-free self-distillationHan Wang, Ruiliu Fu, Chengzhang Li … Qingwei ZhaoApplied Intelligence · Chinese Academy of Sciences · Institute of Acoustics · +1
    PDF ↗
  45. 2021
    Non-IID data and Continual Learning processes in Federated Learning: A long road aheadMarcos F. Criado, Fernando E. Casado, Roberto Iglesias … Senén BarroInformation Fusion · Universidade de Santiago de Compostela · Universidade da Coruña
    PDF ↗
  46. 2021
    Stochastic consolidation of lifelong memoryNimrod Shaham, Jay Chandra, Gabriel Kreiman, Haim SompolinskyScientific Reports · Harvard University · Hebrew University of Jerusalem · +1
  47. 2021
    Continual Contrastive Learning for Image ClassificationZhiwei Lin, Yongtao Wang, Hongxiang LinIEEE International Conference on Multimedia and Expo (ICME) · Peking University
    PDF ↗
  48. 2021
    Smaller is Better: An Analysis of Instance Quantity/Quality Trade-off in Rehearsal-based Continual LearningFrancesco Pelosin, Andrea TorselloIJCNN · Ca' Foscari University of Venice
    PDF ↗
  49. 2021
    LIQA: Lifelong Blind Image Quality AssessmentJianzhao Liu, Wei Zhou, Xin Li … Zhibo ChenIEEE Trans. Multimedia · University of Science and Technology of China
    PDF ↗
  50. 2021
    CoLLIE: Continual Learning of Language Grounding from Language-Image EmbeddingsGabriel Skantze, Bram WillemsenJournal of Artificial Intelligence Research · KTH Royal Institute of Technology
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.