Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

958 papers of 6,984 · showing 751–800Sort Recent · Most cited
  1. 2023
    Dynamically Modular and Sparse General Continual LearningArnav Varma, Elahe Arani, Bahram ZonoozVISIGRAPP
    PDF ↗
  2. 2023
    FeTrIL: Feature Translation for Exemplar-Free Class-Incremental LearningGrégoire Petit, Adrian Popescu, Hugo Schindler … Bertrand DelezoideWACV · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +3
    PDF ↗
  3. 2023
    A Continual Deepfake Detection Benchmark: Dataset, Methods, and EssentialsChuqiao Li, Zhiwu Huang, Danda Pani Paudel … Luc Van GoolWACV · Singapore Management University · Xi'an Jiaotong University · +2
    PDF ↗
  4. 2023
    Memorizing Complementation Network for Few-Shot Class-Incremental LearningZhong Ji, Zhishen Hou, Xiyao Liu … Xuelong LiTIP · Tianjin University · Shenyang Institute of Automation · +2
    PDF ↗
  5. 2023
    Rehearsal-free Continual Language Learning via Efficient Parameter IsolationZhicheng Wang, Yufang Liu, Tao Ji … Wenqiu ZengACL · East China Normal University · China Institute of Finance and Capital Markets
    PDF ↗
  6. 2023
  7. 2023
    Continual SLAM: Beyond Lifelong Simultaneous Localization and Mapping through Continual LearningNiclas Vödisch, Daniele Cattaneo, Wolfram Burgard, Abhinav ValadaSpringer · University of Freiburg · University of Technology Nuremberg
    PDF ↗
  8. 2023
    PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement LearningHojoon Lee, Jaegul Choo, Hyunseung Kim … Chulhee YunNeurIPS
    PDF ↗
  9. 2023
    An Efficient Dataset Condensation Plugin and Its Application to Continual LearningEnneng Yang, Li Shen, Zhenyi Wang … Guibing GuoNeurIPS
  10. 2023
    Improving Gender Fairness of Pre-Trained Language Models without Catastrophic ForgettingZahra Fatemi, Xing Chen, Wenhao Liu, Caimming XiongACL · University of Illinois Chicago · University of Chicago · +1
    PDF ↗
  11. 2023
    Consistent Prototype Learning for Few-Shot Continual Relation ExtractionXiudi Chen, Hui Wu, Xiaodong ShiACL · Xiamen University
    PDF ↗
  12. 2023
  13. 2023
  14. 2023
    Do Pre-trained Models Benefit Equally in Continual Learning?Kuan-Ying Lee, Yuanyi Zhong, Yu-Xiong WangWACV · University of Illinois Urbana-Champaign
    PDF ↗
  15. 2023
    Attribution-aware Weight Transfer: A Warm-Start Initialization for Class-Incremental Semantic SegmentationDipam Goswami, René Schuster, Joost van de Weijer, Didier StrickerWACV · German Research Centre for Artificial Intelligence · Birla Institute of Technology and Science, Pilani · +2
    PDF ↗
  16. 2023
    Saliency Guided Experience Packing for Replay in Continual LearningGobinda Saha, Kaushik RoyWACV · Purdue University West Lafayette
    PDF ↗
  17. 2023
    Large-scale Lifelong Learning of In-context Instructions and How to Tackle ItJisoo Mok, Jaeyoung Do, Sung‐Jin Lee … Sungroh YoonACL · Seoul National University · New Generation University College · +4
    PDF ↗
  18. 2023
    SSFE-Net: Self-Supervised Feature Enhancement for Ultra-Fine-Grained Few-Shot Class Incremental LearningZicheng Pan, Xiaohan Yu, Miaohua Zhang, Yongsheng GaoWACV · Griffith University
  19. 2023
    InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction TuningSamuel Cahyawijaya, Holy Lovenia, Tiezheng Yu … Pascale FungFirst Workshop in South East Asian Language Processing · Hong Kong University of Science and Technology · Red Cross Hospital
    PDF ↗
  20. 2023
    Knowledge Transfer in Incremental Learning for Multilingual Neural Machine TranslationKaiyu Huang, Peng Li, Jin Ma … Yang LiuACL · Tsinghua University · Beijing Academy of Artificial Intelligence · +5
    PDF ↗
  21. 2023
    Learning “O” Helps for Learning More: Handling the Unlabeled Entity Problem for Class-incremental NERRuotian Ma, Xuanting Chen, Lin Zhang … Yun Wen ChenACL · Fudan University · Wanfang Data (China)
    PDF ↗
  22. 2023
    COOM: A Game Benchmark for Continual Reinforcement LearningTristan Tomilin, Meng Fang, Yudi Zhang, Mykola PechenizkiyNeurIPS
  23. 2023
    Continual Learning with Dependency Preserving HypernetworksDupati Srikar Chandra, Sakshi Varshney, P. K. Srijith, Sunil GuptaWACV · Indian Institute of Technology Hyderabad · Deakin University
    PDF ↗
  24. 2023PDF ↗
  25. 2023
    Cross-lingual Continual LearningMeryem M’hamdi, Xiang Ren, Jonathan MayACL · University of Southern California · California Southern University
    PDF ↗
  26. 2023
  27. 2023
    Nearly Optimal Bounds for Cyclic ForgettingWilliam Swartworth, Deanna Needell, Rachel Ward … Halyun JeongNeurIPS
  28. 2023
    Continual Learning for Multilingual Neural Machine Translation via Dual Importance-based Model DivisionJunpeng Liu, Kaiyu Huang, Hao Yu … Degen HuangEMNLP · Dalian University of Technology · Tsinghua University · +1
    PDF ↗
  29. 2023
  30. 2023
    Neural Weight Search for Scalable Task Incremental LearningJiang Jian, Oya ÇeliktutanWACV · King's College London
    PDF ↗
  31. 2023PDF ↗
  32. 2023
    Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse NetworksGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiySpringer LNCS · Eindhoven University of Technology · University of Twente
    PDF ↗
  33. 2023
    Experts Collaboration Learning for Continual Multi-Modal ReasoningLi Xu, Jun LiuTIP · Singapore University of Technology and Design
  34. 2023
    Does Continual Learning Meet Compositionality? New Benchmarks and An Evaluation FrameworkWeiduo Liao, Ying Wei, Mingchen Jiang … Hisao IshibuchiNeurIPS
  35. 2023
    Generative Replay Inspired by Hippocampal Memory Indexing for Continual Language LearningAru Maekawa, Hidetaka Kamigaito, Kotaro Funakoshi, Manabu OkumuraEACL · Tokyo Institute of Technology · Nara Institute of Science and Technology
    PDF ↗
  36. 2023
    Multi-Agent Lifelong Implicit Neural LearningSoheil Kolouri, Ali Abbasi, Soroush Abbasi Koohpayegani … Hamed PirsiavashIEEE Signal Processing Letters · Vanderbilt University · University of California, Davis
  37. 2023
    Replay to Remember: Continual Layer-Specific Fine-tuning for German Speech RecognitionTheresa Pekarek Rosin, Stefan WermterSpringer LNCS · Universität Hamburg · Hamburg University of Technology
    PDF ↗
  38. 2023
    Self-Organizing Multiple Readouts for Reservoir ComputingYuichiro Tanaka, Hakaru TamukohIEEE Access · Kyushu Institute of Technology
    PDF ↗
  39. 2023
    A Continual Learning Algorithm Based on Orthogonal Gradient Descent Beyond Neural Tangent Kernel RegimeDa Eun Lee, Kensuke Nakamura, Jae-Ho Tak, Byung‐Woo HongIEEE Access · Chung-Ang University
    PDF ↗
  40. 2023
    A New Multinetwork Mean Distillation Loss Function for Open-World Domain Incremental Object DetectionJing Yang, Kun Yuan, Suhao Chen … Bin LiInternational Journal of Intelligent Systems · Guizhou University · Ministry of Education · +2
    PDF ↗
  41. 2023
    Meta-Learning Based Tasks Similarity Representation for Cross Domain Lifelong LearningMingge Shen, Dehu Chen, Teng RenIEEE Access · Changzhou Academy of Intelli-Ag Equipment (China) · Wenzhou University · +2
    PDF ↗
  42. 2023
    When Continual Learning Meets Robotic Grasp Detection: A Novel Benchmark on the Jacquard DatasetRui Yang, Matthieu Grard, Emmanuel Dellandréa, Liming ChenInternational Joint Conference on Computer Vision, Imagin… · École Centrale de Lyon
    PDF ↗
  43. 2023
    AdvisIL - A Class-Incremental Learning AdvisorEva Feillet, Grégoire Petit, Adrian Popescu … Céline HudelotWACV · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +2
    PDF ↗
  44. 2023
    Class-Prompting Transformer for Incremental Semantic SegmentationZichen Song, Zhaofeng Shi, Chao Shang … Linfeng XuIEEE Access · University of Electronic Science and Technology of China
  45. 2023
    Multilingual Continual Learning Approaches for Text ClassificationReveal, Chicago, IL, USA, Karan Praharaj, Irina Matveeva, Reveal, Chicago, IL, USAConference Recent Advances in Natural Language Processing…
    PDF ↗
  46. 2023
    Soft Alignment Objectives for Robust Adaptation of Language GenerationMichal Štefánik, Marek Kadlčík, Petr SojkaACL · Masaryk University
    PDF ↗
  47. 2023
    Visually Grounded Continual Language Learning with Selective SpecializationKyra Ahrens, Lennart Bengtson, Jae Yeol Lee, Stefan WermterEMNLP · Universität Hamburg
    PDF ↗
  48. 2023
    CLiCK: Continual Learning Exploiting Intermediate Network Models With A Slack ClassHyejin Kim, Seunghyun Yoon, Hyuk LimIEEE Access · Gwangju Institute of Science and Technology
    PDF ↗
  49. 2023
    Generalising via Meta-Examples for Continual Learning in the WildAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniSpringer LNCS · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  50. 2023
    Incorporating Syntactic Knowledge into Pre-trained Language Model using Optimization for Overcoming Catastrophic ForgettingRan Iwamoto, Issei Yoshida, Hiroshi Kanayama … Masayasu MuraokaEMNLP · Keio University · IBM Research - Tokyo
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.