Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

183 papers of 8,653 · showing 51–100Sort Recent · Most cited
  1. 2023
    TRACE: A Comprehensive Benchmark for Continual Learning in Large Language ModelsXiao Wang, Yuansen Zhang, Tianze Chen … Xuanjing HuangarXiv
    PDF ↗
  2. 2023PDF ↗
  3. 2023
    Saliency-Guided Hidden Associative Replay for Continual LearningGuangji Bai, Qilong Zhao, Xiaoyang Jiang … Liang ZhaoarXiv
    PDF ↗
  4. 2023PDF ↗
  5. 2023
    Hadamard Domain Training with Integers for Class Incremental Quantized LearningMartin Schiemer, Clemens J. S. Schaefer, Jayden Parker Vap … Siddharth JoshiarXiv
    PDF ↗
  6. 2023PDF ↗
  7. 2023
    Towards guarantees for parameter isolation in continual learningGiulia Lanzillotta, Sidak Pal Singh, Benjamin F. Grewe, Thomas HofmannarXiv
    PDF ↗
  8. 2023
    Primal Dual Continual Learning: Balancing Stability and Plasticity through Adaptive Memory AllocationJuan Elenter, Navid Naderializadeh, Tara Javidi, Alejandro RibeiroarXiv
    PDF ↗
  9. 2023
    ConPET: Continual Parameter-Efficient Tuning for Large Language ModelsChenyang Song, Xu Han, Zheni Zeng … Tao YangarXiv
    PDF ↗
  10. 2023PDF ↗
  11. 2023
    Investigating the Catastrophic Forgetting in Multimodal Large Language ModelsYuexiang Zhai, Shengbang Tong, Li Xiao … Yi MaarXiv
    PDF ↗
  12. 2023
    Stabilizing RLHF through Advantage Model and Selective RehearsalBaolin Peng, Linfeng Song, Ye Tian … Yu DongarXiv
    PDF ↗
  13. 2023PDF ↗
  14. 2023PDF ↗
  15. 2023
    Continual Learning with Dirichlet Generative-based RehearsalMin Zeng, Wei Xue, Qifeng Liu, Yike GuoarXiv
    PDF ↗
  16. 2023
    Measuring Catastrophic Forgetting in Cross-Lingual Transfer Paradigms: Exploring Tuning StrategiesBoshko Koloski, Blaž Škrlj, Marko Robnik‐Šikonja, Senja PollakarXiv
    PDF ↗
  17. 2023
    Prompt Learning With Knowledge Memorizing Prototypes For Generalized Few-Shot Intent DetectionChaiyut Luoyiching, Yangning Li, Yinghui Li … Hanjing SuarXiv
    PDF ↗
  18. 2023
    Image-Object-Specific Prompt Learning for Few-Shot Class-Incremental LearningIn-Ug Yoon, Tae-Min Choi, Sun-Kyung Lee … Jong-Hwan KimarXiv
    PDF ↗
  19. 2023
    Big-model Driven Few-shot Continual LearningZiqi Gu, Chunyan Xu, Zihan Lu … Zhen CuiarXiv
    PDF ↗
  20. 2023
    New metrics for analyzing continual learnersNicolas Michel, Giovanni Chierchia, Romain Negrel … Toshihiko YamasakiarXiv · Laboratoire d'Informatique Gaspard-Monge · Université Gustave Eiffel
    PDF ↗
  21. 2023PDF ↗
  22. 2023
    Graph Relation Aware Continual LearningQinghua Shen, Weijieying Ren, Wei QinarXiv
    PDF ↗
  23. 2023
    OpenGCD: Assisting Open World Recognition with Generalized Category DiscoveryFulin Gao, Weimin Zhong, Zhixing Cao … Zhi LiarXiv
    PDF ↗
  24. 2023PDF ↗
  25. 2023
    NEOLAF, an LLM-powered neural-symbolic cognitive architectureRichard Jiarui Tong, Cao, Cassie Chen, Timothy Xueqian Lee … Yu LuarXiv
    PDF ↗
  26. 2023PDF ↗
  27. 2023
    Efficient Model Adaptation for Continual Learning at the EdgeZachary Daniels, Jun Hu, Michael Lomnitz … David ZhangarXiv
    PDF ↗
  28. 2023
    Training Data Protection with Compositional Diffusion ModelsAditya Golatkar, Alessandro Achille, Ashwin Swaminathan, Stefano SoattoarXiv
    PDF ↗
  29. 2023PDF ↗
  30. 2023
    XLDA: Linear Discriminant Analysis for Scaling Continual Learning to Extreme Classification at the EdgeKaran Shah, Vishruth Veerendranath, Anushka Hebbar, Raghavendra BhatarXiv
    PDF ↗
  31. 2023PDF ↗
  32. 2023
    Towards Robust and Efficient Continual Language LearningAdam Fisch, Amal Rannen-Triki, Razvan Pascanu … Marc’Aurelio RanzatoarXiv
    PDF ↗
  33. 2023
    Scaling Distributed Multi-task Reinforcement Learning with Experience SharingSanae Amani, Khushbu Pahwa, Vladimir Braverman, Lin F. YangarXiv
    PDF ↗
  34. 2023
    EgoAdapt: A multi-stream evaluation study of adaptation to real-world egocentric user videoMatthias De Lange, Hamid Eghbal-zadeh, Reuben Tan … Karl RidgewayarXiv
    PDF ↗
  35. 2023
    Fed-CPrompt: Contrastive Prompt for Rehearsal-Free Federated Continual LearningGaurav Bagwe, Xiaoyong Yuan, Miao Pan, Lan ZhangarXiv
    PDF ↗
  36. 2023
    Don't Memorize; Mimic The Past: Federated Class Incremental Learning Without Episodic MemorySara Babakniya, Zalan Fabian, Chaoyang He … Salman AvestimehrarXiv
    PDF ↗
  37. 2023
    Maintaining Plasticity in Deep Continual LearningShibhansh Dohare, J. Fernando Hernandez-Garcia, Parash Rahman … Richard S. SuttonarXiv
    PDF ↗
  38. 2023
    On The Relationship Between Continual Learning and Long-Tailed RecognitionMahdiyar Molahasani, Michael Greenspan, Ali EtemadarXiv
    PDF ↗
  39. 2023
    Explainable Lifelong Stream Learning Based on "Glocal" Pairwise FusionChu Kiong Loo, Wei Shiung Liew, Stefan WermterarXiv
    PDF ↗
  40. 2023PDF ↗
  41. 2023
    Knowledge Transfer-Driven Few-Shot Class-Incremental LearningYe Wang, Yaxiong Wang, Guoshuai Zhao, Xueming QianarXiv
    PDF ↗
  42. 2023
    IF2Net: Innately Forgetting-Free Networks for Continual LearningD. Li, Tianqi Wang, Bingrong Xu … Ponnuthurai Nagaratnam SuganthanarXiv
    PDF ↗
  43. 2023
    Studying Generalization on Memory-Based Methods in Continual LearningFelipe del Rio, Julio Hurtado, Cristian Buc … Vincenzo LomonacoarXiv
    PDF ↗
  44. 2023PDF ↗
  45. 2023
    POP: Prompt Of Prompts for Continual LearningZhiyuan Hu, Jiancheng Lyu, Dashan Gao, Nuno VasconcelosarXiv
    PDF ↗
  46. 2023
    Dynamically Masked Discriminator for Generative Adversarial NetworksWentian Zhang, Haozhe Liu, Bing Li … Bernard GhanemarXiv
    PDF ↗
  47. 2023PDF ↗
  48. 2023
    ModuleFormer: Modularity Emerges from Mixture-of-ExpertsYikang Shen, Zheyu Zhang, Tianyou Cao … Chuang GanarXiv
    PDF ↗
  49. 2023
    Putting Humans in the Image Captioning LoopAliki Anagnostopoulou, Mareike Hartmann, Daniel SonntagarXiv
    PDF ↗
  50. 2023PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.