Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

240 papers of 8,653 · showing 151–200Sort Recent · Most cited
  1. 2023
    Online Bias Correction for Task-Free Continual LearningA. Chrysakis, Marie-Francine MoensICLR
  2. 2023
    Online Boundary-Free Continual Learning by Scheduled Data PriorHyun-woo Koh, M. Seo, Jihwan Bang … Jonghyun ChoiICLR
  3. 2023
  4. 2023
    Continual Learning of Language ModelsZixuan Ke, Yijia Shao, Haowei Lin … Bin LiuICLR
  5. 2023
  6. 2023
    Optimizing Spca-based Continual Learning: A Theoretical ApproachChunchun Yang, Malik Tiomoko, Zengfu WangICLR
  7. 2023
    Self-Supervised Continual LearningK. Thakral, S. Mittal, Utkarsh Uppal … Richa SinghICLR
  8. 2023
  9. 2023
    Building a Subspace of Policies for Scalable Continual LearningJean-Baptiste Gaya, Thang Doan, Lucas Caccia … Roberta RăileanuICLR · Sorbonne Université · Institut Systèmes Intelligents et de Robotique · +2
    PDF ↗
  10. 2023
    On the Soft-Subnetwork for Few-shot Class Incremental LearningHaeyong Kang, Jaehong Yoon, Sultan Rizky Hikmawan Madjid … Chang D. YooICLR
    PDF ↗
  11. 2023
    A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental LearningDa-Wei Zhou, Qiwei Wang, Han-Jia Ye, De‐Chuan ZhanICLR
    PDF ↗
  12. 2023
    Continual evaluation for lifelong learning: Identifying the stability gapMatthias De Lange, Gido M. van de Ven, Tinne TuytelaarsICLR
    PDF ↗
  13. 2023PDF ↗
  14. 2022
    Information-theoretic Online Memory Selection for Continual LearningShengyang Sun, Daniele Calandriello, Huiyi Hu … Michalis K. TitsiasICLR
    PDF ↗
  15. 2022PDF ↗
  16. 2022
    Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with MomentumKirby Banman, Liam Peet-Pare, Nidhi Hegde … Martha WhiteICLR
    PDF ↗
  17. 2022
    Acceleration of Federated Learning with Alleviated Forgetting in Local TrainingChencheng Xu, Zhiwei Hong, Minlie Huang, Tao JiangICLR
    PDF ↗
  18. 2023
    Learning Fast and Slow for Online Time Series ForecastingQuang Pham, Chenghao Liu, Doyen Sahoo, Steven C. H. HoiICLR
    PDF ↗
  19. 2022
    Memory Replay with Data Compression for Continual LearningLiyuan Wang, Xingxing Zhang, Kuo Yang … Jun ZhuICLR
    PDF ↗
  20. 2023
    Incremental Learning of Structured Memory via Closed-Loop TranscriptionShengbang Tong, Xili Dai, Ziyang Wu … Yi MaICLR
    PDF ↗
  21. 2022
    TRGP: Trust Region Gradient Projection for Continual LearningSen Lin, Li Yang, Deliang Fan, Junshan ZhangICLR
    PDF ↗
  22. 2022PDF ↗
  23. 2022PDF ↗
  24. 2022
    Effect of scale on catastrophic forgetting in neural networksV. Ramasesh, Aitor Lewkowycz, Ethan DyerICLR
  25. 2022
    Pretrained Language Model in Continual Learning: A Comparative StudyTongtong Wu, Massimo Caccia, Zhuang Li … Gholamreza HaffariICLR
  26. 2022
    Looking Back on Learned Experiences For Class/task Incremental LearningMozhgan Pourkeshavarz, Guoying Zhao, M. SabokrouICLR
  27. 2022
    Continual Learning with Filter Atom SwappingZichen Miao, Ze Wang, Wei Chen, Qiang QiuICLR
  28. 2022
  29. 2022
    CoMPS: Continual Meta Policy SearchGlen Berseth, Zhiwei Zhang, Grace Zhang … Sergey LevineICLR
    PDF ↗
  30. 2022PDF ↗
  31. 2022
    Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime InferenceHyunseo Koh, Dahyun Kim, Jung-Woo Ha, Jonghyun ChoiICLR · Gwangju Institute of Science and Technology
    PDF ↗
  32. 2022
    Representational Continuity for Unsupervised Continual LearningDivyam Madaan, Jaehong Yoon, Yuanchun Li … Sung Ju HwangICLR
    PDF ↗
  33. 2022
    Subspace Regularizers for Few-Shot Class Incremental LearningAfra Feyza Aky\"urek, Afra Feyza Akyürek, Derry Wijaya, Jacob AndreasICLR
    PDF ↗
  34. 2022
    Towards Continual Knowledge Learning of Language ModelsJoel Jang, Seonghyeon Ye, Sohee Yang … Minjoon SeoICLR · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  35. 2022
    CLEVA-Compass: A Continual Learning EValuation Assessment Compass to Promote Research Transparency and ComparabilityMartin Mundt, Steven Lang, Quentin Delfosse, Kristian KerstingICLR · Technische Universität Darmstadt
    PDF ↗
  36. 2022
    Objects in Semantic TopologyShuo Yang, Peize Sun, Yi Jiang … Min XuICLR
    PDF ↗
  37. 2022
    Sequential Reptile: Inter-Task Gradient Alignment for Multilingual LearningSeanie Lee, Haebeom Lee, Juho Lee, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  38. 2022PDF ↗
  39. 2022
    Online Coreset Selection for Rehearsal-based Continual LearningJaehong Yoon, Divyam Madaan, Eunho Yang, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  40. 2022
    How Well Does Self-Supervised Pre-Training Perform with Streaming Data?Dapeng Hu, Shipeng Yan, Qizhengqiu Lu … Jiashi FengICLR
    PDF ↗
  41. 2022
    New Insights on Reducing Abrupt Representation Change in Online Continual LearningLucas Caccia, Rahaf Aljundi, Nader Asadi … Eugene BelilovskyICLR
    PDF ↗
  42. 2021
    Gradient Projection Memory for Continual LearningGobinda Saha, Garg, Isha, Roy, KaushikICLR · Purdue University West Lafayette
    PDF ↗
  43. 2021
    EEC: Learning to Encode and Regenerate Images for Continual LearningAli Ayub, Alan R. WagnerICLR · Pennsylvania State University
    PDF ↗
  44. 2021
  45. 2021
    Long Live the Lottery: The Existence of Winning Tickets in Lifelong LearningTianlong Chen, Zhenyu (Allen) Zhang, Sijia Liu … Zhangyang WangICLR
  46. 2021
    Contextual Transformation Networks for Online Continual LearningQ. Pham, Chenghao Liu, Doyen Sahoo, S. HoiICLR
  47. 2021
    Rethinking the Representational Continuity: Towards Unsupervised Continual LearningDivyam Madaan, Jaehong Yoon, Yuanchun Li … Sung Ju HwangICLR
  48. 2021
    Efficient Continual Learning with Modular Networks and Task-Driven PriorsTom Véniat, Ludovic Denoyer, Marc’Aurelio RanzatoICLR · Meta (United States)
    PDF ↗
  49. 2021
    Reset-Free Lifelong Learning with Skill-Space PlanningKevin Lü, Aditya Grover, Pieter Abbeel, Igor MordatchICLR · University of California, Berkeley · Stanford University · +1
    PDF ↗
  50. 2021
    Generalized Variational Continual LearningNoel Loo, Siddharth Swaroop, Richard E. TurnerICLR · University of Cambridge
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.