Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

183 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2023PDF ↗
  2. 2023
    Continual Adversarial DefenseQian Wang, Hefei Ling, Yingwei Li … Yu NingarXiv
    PDF ↗
  3. 2023
    Bayesian Metaplasticity from Synaptic UncertaintyDjohan Bonnet, Tifenn Hirtzlin, Tarcisius Januel … Elisa VianelloarXiv
    PDF ↗
  4. 2023PDF ↗
  5. 2023PDF ↗
  6. 2023PDF ↗
  7. 2023
    Benchmarking Continual Learning from Cognitive PerspectivesXiaoqian Liu, Junge Zhang, Mingyi Zhang, Peipei YangarXiv
    PDF ↗
  8. 2023
    Directions of Curvature as an Explanation for Loss of PlasticityAlex Lewandowski, Haruto Tanaka, Dale Schuurmans, Marlos C. MachadoarXiv
    PDF ↗
  9. 2023
    Neuromorphic Incremental on-chip Learning with Hebbian Weight ConsolidationZifan Ning, Chaojin Chen, Xiang Cheng … Bo XuarXiv
    PDF ↗
  10. 2023
    Prompt-Based Exemplar Super-Compression and Regeneration for Class-Incremental LearningRuxiao Duan, Jieneng Chen, Adam Kortylewski … Yaoyao LiuarXiv
    PDF ↗
  11. 2023PDF ↗
  12. 2023
    Continual Learning with Low Rank AdaptationMartin Wistuba, Prabhu Teja Sivaprasad, Lukas Balles, Giovanni ZappellaarXiv
    PDF ↗
  13. 2023PDF ↗
  14. 2023PDF ↗
  15. 2023PDF ↗
  16. 2023PDF ↗
  17. 2023PDF ↗
  18. 2023
    CovarNav: Machine Unlearning via Model Inversion and Covariance NavigationAli Abbasi, Chayne Thrash, Elaheh Akbari … Soheil KolouriarXiv
    PDF ↗
  19. 2023
    What Can AutoML Do For Continual Learning?Mert Kilickaya, Joaquin VanschorenarXiv
    PDF ↗
  20. 2023PDF ↗
  21. 2023
    Towards interpretable-by-design deep learning algorithmsPlamen Angelov, Dmitry Kangin, Ziyang ZhangarXiv
    PDF ↗
  22. 2023PDF ↗
  23. 2023
    Online Continual Knowledge Learning for Language ModelsYuhao Wu, Tongjun Shi, Karthick Sharma … Shuhao ZhangarXiv
    PDF ↗
  24. 2023PDF ↗
  25. 2023
    Assurance for Deployed Continual Learning SystemsAri Goodman, Ryan O'Shea, Noam Hirschorn, Hubert ChrostowskiarXiv
    PDF ↗
  26. 2023PDF ↗
  27. 2023
    Extending Multilingual Machine Translation through Imitation LearningWen‐Cheng Lai, Viktor Hangya, Shen, Yingli, Fraser, AlexanderarXiv
    PDF ↗
  28. 2023PDF ↗
  29. 2023
    Efficiently Adapting Pretrained Language Models To New LanguagesZoltan Csaki, Pian Pawakapan, Urmish Thakker, Qiantong XuarXiv
    PDF ↗
  30. 2023
    Task Arithmetic with LoRA for Continual LearningRajas Chitale, Ankit Vaidya, Aditya Kane, Archana GhotkararXiv
    PDF ↗
  31. 2023
    A Definition of Open-Ended Learning Problems for Goal-Conditioned AgentsOlivier Sigaud, Gianluca Baldassarre, Cédric Colas … Vieri Giuliano SantucciarXiv · Sorbonne Université · Institut Systèmes Intelligents et de Robotique · +5
    PDF ↗
  32. 2023PDF ↗
  33. 2023PDF ↗
  34. 2023
    Class Incremental Learning with Pre-trained Vision-Language ModelsXialei Liu, Xusheng Cao, Haori Lu … Ming‐Ming ChengarXiv
    PDF ↗
  35. 2023
    Constructing Sample-to-Class Graph for Few-Shot Class-Incremental LearningFuyuan Hu, Jian Zhang, Fan Lyu … Fenglei XuarXiv
    PDF ↗
  36. 2023PDF ↗
  37. 2023PDF ↗
  38. 2023
    Neuro-Inspired Fragmentation and Recall to Overcome Catastrophic Forgetting in CuriosityJaedong Hwang, Zhang-Wei Hong, Eric Chen … Ila FietearXiv
    PDF ↗
  39. 2023
    COPR: Continual Learning Human Preference through Optimal Policy RegularizationHan Zhang, Lin Gui, Yuanzhao Zhai … Ruifeng XuarXiv
    PDF ↗
  40. 2023PDF ↗
  41. 2023
    Towards a General Framework for Continual Learning with Pre-trainingLiyuan Wang, Jingyi Xie, Xingxing Zhang … Jun ZhuarXiv
    PDF ↗
  42. 2023
    Continual Invariant Risk MinimizationFrancesco Alesiani, Shujian Yu, Mathias NiepertarXiv
    PDF ↗
  43. 2023PDF ↗
  44. 2023
    Bayesian Flow Networks in Continual LearningMateusz Pyla, Kamil Rafał Deja, Bartłomiej Twardowski, T. P. TrzcinskiarXiv
    PDF ↗
  45. 2023
    Enhancing Plasticity for First Session Adaptation Continual LearningImad Eddine Marouf, Subhankar Roy, Stéphane Lathuilière, Enzo TartaglionearXiv
    PDF ↗
  46. 2023
    CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and GeneralizationBodhisattwa Prasad Majumder, Bhavana Dalvi Mishra, Peter Jansen … Peter E. ClarkarXiv
    PDF ↗
  47. 2023
    Prior-Free Continual Learning with Unlabeled Data in the WildTao Zhuo, Zhiyong Cheng, Hehe Fan, Mohan KankanhalliarXiv
    PDF ↗
  48. 2023PDF ↗
  49. 2023
    Incremental Object Detection with CLIPZiyue Huang, Yupeng He, Qingjie Liu, Yunhong WangarXiv
    PDF ↗
  50. 2023PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.