Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

120 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2023
    Continual Adversarial DefenseQian Wang, Hefei Ling, Yingwei Li … Yu NingarXiv
    PDF ↗
  2. 2023
    Bayesian Metaplasticity from Synaptic UncertaintyDjohan Bonnet, Tifenn Hirtzlin, Tarcisius Januel … Elisa VianelloarXiv
    PDF ↗
  3. 2023PDF ↗
  4. 2023PDF ↗
  5. 2023PDF ↗
  6. 2023
    Benchmarking Continual Learning from Cognitive PerspectivesXiaoqian Liu, Junge Zhang, Mingyi Zhang, Peipei YangarXiv
    PDF ↗
  7. 2023
    Directions of Curvature as an Explanation for Loss of PlasticityAlex Lewandowski, Haruto Tanaka, Dale Schuurmans, Marlos C. MachadoarXiv
    PDF ↗
  8. 2023
    Prompt-Based Exemplar Super-Compression and Regeneration for Class-Incremental LearningRuxiao Duan, Jieneng Chen, Adam Kortylewski … Yaoyao LiuarXiv
    PDF ↗
  9. 2023
    Continual Learning with Low Rank AdaptationMartin Wistuba, Prabhu Teja Sivaprasad, Lukas Balles, Giovanni ZappellaarXiv
    PDF ↗
  10. 2023PDF ↗
  11. 2023PDF ↗
  12. 2023PDF ↗
  13. 2023
    CovarNav: Machine Unlearning via Model Inversion and Covariance NavigationAli Abbasi, Chayne Thrash, Elaheh Akbari … Soheil KolouriarXiv
    PDF ↗
  14. 2023
    What Can AutoML Do For Continual Learning?Mert Kilickaya, Joaquin VanschorenarXiv
    PDF ↗
  15. 2023
    Towards interpretable-by-design deep learning algorithmsPlamen Angelov, Dmitry Kangin, Ziyang ZhangarXiv
    PDF ↗
  16. 2023PDF ↗
  17. 2023
    Extending Multilingual Machine Translation through Imitation LearningWen‐Cheng Lai, Viktor Hangya, Shen, Yingli, Fraser, AlexanderarXiv
    PDF ↗
  18. 2023
    Efficiently Adapting Pretrained Language Models To New LanguagesZoltan Csaki, Pian Pawakapan, Urmish Thakker, Qiantong XuarXiv
    PDF ↗
  19. 2023
    A Definition of Open-Ended Learning Problems for Goal-Conditioned AgentsOlivier Sigaud, Gianluca Baldassarre, Cédric Colas … Vieri Giuliano SantucciarXiv · Sorbonne Université · Institut Systèmes Intelligents et de Robotique · +5
    PDF ↗
  20. 2023PDF ↗
  21. 2023
    Class Incremental Learning with Pre-trained Vision-Language ModelsXialei Liu, Xusheng Cao, Haori Lu … Ming‐Ming ChengarXiv
    PDF ↗
  22. 2023
    Constructing Sample-to-Class Graph for Few-Shot Class-Incremental LearningFuyuan Hu, Jian Zhang, Fan Lyu … Fenglei XuarXiv
    PDF ↗
  23. 2023PDF ↗
  24. 2023
    Neuro-Inspired Fragmentation and Recall to Overcome Catastrophic Forgetting in CuriosityJaedong Hwang, Zhang-Wei Hong, Eric Chen … Ila FietearXiv
    PDF ↗
  25. 2023
    COPR: Continual Learning Human Preference through Optimal Policy RegularizationHan Zhang, Lin Gui, Yuanzhao Zhai … Ruifeng XuarXiv
    PDF ↗
  26. 2023PDF ↗
  27. 2023
    Towards a General Framework for Continual Learning with Pre-trainingLiyuan Wang, Jingyi Xie, Xingxing Zhang … Jun ZhuarXiv
    PDF ↗
  28. 2023
    Continual Invariant Risk MinimizationFrancesco Alesiani, Shujian Yu, Mathias NiepertarXiv
    PDF ↗
  29. 2023PDF ↗
  30. 2023
    Bayesian Flow Networks in Continual LearningMateusz Pyla, Kamil Rafał Deja, Bartłomiej Twardowski, T. P. TrzcinskiarXiv
    PDF ↗
  31. 2023
    Enhancing Plasticity for First Session Adaptation Continual LearningImad Eddine Marouf, Subhankar Roy, Stéphane Lathuilière, Enzo TartaglionearXiv
    PDF ↗
  32. 2023
    CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and GeneralizationBodhisattwa Prasad Majumder, Bhavana Dalvi Mishra, Peter Jansen … Peter E. ClarkarXiv
    PDF ↗
  33. 2023
    Prior-Free Continual Learning with Unlabeled Data in the WildTao Zhuo, Zhiyong Cheng, Hehe Fan, Mohan KankanhalliarXiv
    PDF ↗
  34. 2023
    Incremental Object Detection with CLIPZiyue Huang, Yupeng He, Qingjie Liu, Yunhong WangarXiv
    PDF ↗
  35. 2023PDF ↗
  36. 2023
    TRACE: A Comprehensive Benchmark for Continual Learning in Large Language ModelsXiao Wang, Yuansen Zhang, Tianze Chen … Xuanjing HuangarXiv
    PDF ↗
  37. 2023PDF ↗
  38. 2023PDF ↗
  39. 2023
    Towards guarantees for parameter isolation in continual learningGiulia Lanzillotta, Sidak Pal Singh, Benjamin F. Grewe, Thomas HofmannarXiv
    PDF ↗
  40. 2023
    Primal Dual Continual Learning: Balancing Stability and Plasticity through Adaptive Memory AllocationJuan Elenter, Navid Naderializadeh, Tara Javidi, Alejandro RibeiroarXiv
    PDF ↗
  41. 2023
    ConPET: Continual Parameter-Efficient Tuning for Large Language ModelsChenyang Song, Xu Han, Zheni Zeng … Tao YangarXiv
    PDF ↗
  42. 2023
    Investigating the Catastrophic Forgetting in Multimodal Large Language ModelsYuexiang Zhai, Shengbang Tong, Li Xiao … Yi MaarXiv
    PDF ↗
  43. 2023
    Stabilizing RLHF through Advantage Model and Selective RehearsalBaolin Peng, Linfeng Song, Ye Tian … Yu DongarXiv
    PDF ↗
  44. 2023PDF ↗
  45. 2023PDF ↗
  46. 2023
    Continual Learning with Dirichlet Generative-based RehearsalMin Zeng, Wei Xue, Qifeng Liu, Yike GuoarXiv
    PDF ↗
  47. 2023
    Measuring Catastrophic Forgetting in Cross-Lingual Transfer Paradigms: Exploring Tuning StrategiesBoshko Koloski, Blaž Škrlj, Marko Robnik‐Šikonja, Senja PollakarXiv
    PDF ↗
  48. 2023
    Prompt Learning With Knowledge Memorizing Prototypes For Generalized Few-Shot Intent DetectionChaiyut Luoyiching, Yangning Li, Yinghui Li … Hanjing SuarXiv
    PDF ↗
  49. 2023
    Image-Object-Specific Prompt Learning for Few-Shot Class-Incremental LearningIn-Ug Yoon, Tae-Min Choi, Sun-Kyung Lee … Jong-Hwan KimarXiv
    PDF ↗
  50. 2023
    Big-model Driven Few-shot Continual LearningZiqi Gu, Chunyan Xu, Zihan Lu … Zhen CuiarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.