Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

617 papers of 8,653 · showing 101–150Sort Recent · Most cited
  1. 2022
    On the Effectiveness of Lipschitz-Driven Rehearsal in Continual LearningLorenzo Bonicelli, M. Boschini, Angelo Porrello … Simone CalderaraNeurIPS
    PDF ↗
  2. 2022
    Decomposed Knowledge Distillation for Class-Incremental Semantic SegmentationDonghyeon Baek, Youngmin Oh, Sanghoon Lee … Bumsub HamNeurIPS
    PDF ↗
  3. 2022PDF ↗
  4. 2022
    Federated Continual Learning for Text Classification via Selective Inter-client TransferYatin Chaudhary, Pranav Rai, Matthias Schubert … Pankaj GuptaEMNLP
    PDF ↗
  5. 2022
    System Design for an Integrated Lifelong Reinforcement Learning Agent for Real-Time Strategy GamesIndranil Sur, Zachary Daniels, Abrar Rahman … Aswin RaghavanInternational Conference on AI-ML-Systems · SRI International · American University · +3
    PDF ↗
  6. 2022PDF ↗
  7. 2022
    Schedule-Robust Online Continual LearningRuohan Wang, Marco Ciccone, Giulia Luise … Carlo CilibertoarXiv
    PDF ↗
  8. 2022PDF ↗
  9. 2022
    Continual Training of Language Models for Few-Shot LearningZixuan Ke, Haowei Lin, Yijia Shao … Bing LiuEMNLP
    PDF ↗
  10. 2022PDF ↗
  11. 2022
    A Simple Baseline that Questions the Use of Pretrained-Models in Continual LearningPaul Janson, Wenxuan Zhang, Rahaf Aljundi, Mohamed ElhoseinyarXiv
    PDF ↗
  12. 2022
    Patch-based Knowledge Distillation for Lifelong Person Re-IdentificationZhicheng Sun, Yadong MuACM International Conference on Multimedia · Peking University
  13. 2022
    Incremental Few-Shot Semantic Segmentation via Embedding Adaptive-Update and Hyper-class RepresentationGuangchen Shi, Yirui Wu, Jun Liu … Tong LüACM International Conference on Multimedia · Hohai University · Singapore University of Technology and Design · +3
    PDF ↗
  14. 2022
    Semantics-Driven Generative Replay for Few-Shot Class Incremental LearningAishwarya Agarwal, Biplab Banerjee, Fabio Cuzzolin, Subhasis ChaudhuriACM International Conference on Multimedia · Indian Institute of Technology Bombay · Oxford Brookes University
  15. 2022
    Meta Reconciliation Normalization for Lifelong Person Re-IdentificationNan Pu, Yu Liu, Wei Chen … Michael S. LewACM International Conference on Multimedia · Leiden University · Dalian University of Technology
  16. 2022PDF ↗
  17. 2022
    Improving Continual Relation Extraction through Prototypical Contrastive LearningChengwei Hu, Deqing Yang, Haoliang Jin … Yanghua XiaoCOLING
    PDF ↗
  18. 2022
    Class Gradient Projection For Continual LearningCheng Chen, Ji Zhang, Jingkuan Song, Lianli GaoACM International Conference on Multimedia · University of Electronic Science and Technology of China · Peng Cheng Laboratory
    PDF ↗
  19. 2022
    A Memory Transformer Network for Incremental LearningAhmet İşcen, Thomas Bird, Mathilde Caron … Cordelia SchmidBMVC
    PDF ↗
  20. 2022
    Adapting without forgetting: KnowBert-UMLSGuilhem Piat, Nasredine Semmar, Alexandre Allauzen … Julien TourilleInternational Conference on Wireless and Mobile Computing… · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +1
  21. 2022
    Few-Shot Continual Active Learning by a RobotAli Ayub, Carter FendleyNeurIPS
    PDF ↗
  22. 2022
    Tracking changes using Kullback-Leibler divergence for the continual learningSebastián Basterrech, Michał WoźniakIEEE International Conference on Systems, Man, and Cybern… · VSB - Technical University of Ostrava · Wrocław University of Science and Technology · +1
    PDF ↗
  23. 2022
    Task Detection in Continual Learning via Familiarity AutoencodersMaxwell J. Jacobson, Case Q. Wright, Nan Jiang … Yexiang XueIEEE International Conference on Systems, Man, and Cybern… · Purdue University West Lafayette
  24. 2022
    Efficient continual learning at the edge with progressive segmented trainingXiaocong Du, Shreyas Kolala Venkataramanaiah, Zheng Li … Yu CaoNeuromorphic Computing and Engineering · Arizona State University · Oak Ridge National Laboratory
  25. 2022PDF ↗
  26. 2022
    Improving Replay-Based Continual Semantic Segmentation with Smart Data SelectionTobias Kalb, Bjorn Mauthe, Jürgen BeyererIEEE 25th International Conference on Intelligent Transpo… · Fraunhofer Institute of Optronics, System Technologies and Image Exploitation
    PDF ↗
  27. 2022
    Self-organized Learning from Synthetic and Real-World Data for a Humanoid Exercise RobotNicolas Duczek, Matthias Kerzel, Philipp Allgeuer, Stefan WermterFrontiers · Universität Hamburg
  28. 2022
    CLIP model is an Efficient Continual LearnerVishal Thengane, Salman Khan, Munawar Hayat, Fahad Shahbaz KhanarXiv
    PDF ↗
  29. 2022
    Incremental learning with neural networks for computer vision: a surveyHao Liu, Yong Zhou, Bing Liu … Zhiwen ShaoArtificial Intelligence Review · Ministry of Education of the People's Republic of China · China University of Mining and Technology
  30. 2022
    A Federated Incremental Learning Algorithm Based on Dual Attention MechanismKai Hu, Meixia Lu, Yaogen Li … Yi YangApplied Sciences · Nanjing University of Information Science and Technology · Nanjing University of Science and Technology
  31. 2022
    Weighted entropic associative memory and phonetic learningLuis A. Pineda, Rafael MoralesScientific Reports · Universidad Nacional Autónoma de México · Universidad de Guadalajara
  32. 2022
    ImpressLearn: Continual Learning via Combined Task ImpressionsDhrupad Bhardwaj, Julia Kempe, Artem Vysogorets … Evaristus C. EzekwemarXiv
    PDF ↗
  33. 2022
    ConCS: A Continual Classifier System for Continual Learning of Multiple Boolean ProblemsTrung B. Nguyen, Will N. Browne, Mengjie ZhangIEEE Transactions · Victoria University of Wellington · Queensland University of Technology
    PDF ↗
  34. 2022
    How Relevant is Selective Memory Population in Lifelong Language Learning?Vladimir Araujo, Helena Balabin, Julio Hurtado … Marie‐Francine MoensAACL
    PDF ↗
  35. 2022
    Long-Tailed Class Incremental LearningXialei Liu, Yusong Hu, Xusheng Cao … Ming‐Ming ChengECCV
    PDF ↗
  36. 2022
    Memory Bounds for Continual LearningXi Chen, Christos H. Papadimitriou, Binghui PengIEEE 63rd Annual Symposium on Foundations of Computer Sci… · Columbia University
    PDF ↗
  37. 2022
    Similarity-Driven Adaptive Prototypical Network for Class-incremental Few-shot Named Entity RecognitionYifan Chen, Zhan Huang, Minghao Hu … Xicheng LuIEEE 34th International Conference on Tools with Artifici… · National University of Defense Technology · PLA Academy of Military Science
  38. 2022
    HyperHawkes: Hypernetwork based Neural Temporal Point ProcessManisha Dubey, P. K. Srijith, Maunendra Sankar DesarkararXiv
    PDF ↗
  39. 2022
    Task Formulation Matters When Learning Continually: A Case Study in Visual Question AnsweringMavina Nikandrou, Yu Lu, Alessandro Suglia … Verena RieserarXiv
    PDF ↗
  40. 2022
    Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A SurveyDanielle SaundersJournal of Artificial Intelligence Research · South Bend Museum of Art
    PDF ↗
  41. 2022
    Multiple Modes for Continual LearningSiddhartha Datta, Nigel ShadboltarXiv
    PDF ↗
  42. 2022
    Disentangling Transfer in Continual Reinforcement LearningMaciej Wołczyk, Michał Zając, Razvan Pascanu … Piotr MiłośNeurIPS
    PDF ↗
  43. 2022
    Revealing the real-world applicable setting of online continual learningZhenbo Xu, Hai‐Miao Hu, Liu LiuIEEE 24th International Workshop on Multimedia Signal Pro… · Beihang University
  44. 2022
    Exploring Example Influence in Continual LearningQing Sun, Fan Lyu, Fanhua Shang … Liang WanNeurIPS
    PDF ↗
  45. 2022PDF ↗
  46. 2022
    Uncertainty-Guided Semi-Supervised Few-Shot Class-Incremental Learning With Knowledge DistillationYawen Cui, Wanxia Deng, Xin Xu … Li LiuIEEE Trans. Multimedia · University of Oulu · National University of Defense Technology
  47. 2022
    SparCL: Sparse Continual Learning on the EdgeZifeng Wang, Zheng Zhan, Yifan Gong … Jennifer DyNeurIPS
    PDF ↗
  48. 2022
    TaskDrop: A Competitive Baseline for Continual Learning of Sentiment ClassificationJian-Ping Mei, Yilun Zhen, Qianwei Zhou, Rui YanNeural Networks · Zhejiang University of Science and Technology · Zhejiang University of Technology
    PDF ↗
  49. 2022
    In-memory Realization of In-situ Few-shot Continual Learning with a Dynamically Evolving Explicit MemoryGeethan Karunaratne, Michael Hersche, J. Langeneager … Abbas RahimiESSCIRC 2022- IEEE 48th European Solid State Circuits Con… · ETH Zurich · IBM Research - Zurich · +2
    PDF ↗
  50. 2022
    Updating Only Encoders Prevents Catastrophic Forgetting of End-to-End ASR ModelsYuki Takashima, Shota Horiguchi, Shinji Watanabe … Yohei KawaguchiInterspeech · Hitachi (Japan) · Johns Hopkins University · +1
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.