Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

14 papers of 8,653Sort Recent · Most cited
  1. 2024
    Remembering Transformer for Continual LearningYuwei Sun, Ippei Fujisawa, Arthur Juliani … Ryota KanaiIJCNN · Konya Eğitim ve Araştırma Hastanesi · Microsoft Research (United Kingdom) · +1
    PDF ↗
  2. 2025
    FreewayML: An Adaptive and Stable Streaming Learning Framework for Dynamic Data StreamsZheng Qin, Zheheng Liang, Lijie Xu … Wei WangICDE · Chinese Academy of Sciences · Institute of Software · +3
  3. 2025
    CurLL: A Developmental Framework to Evaluate Continual Learning in Language ModelsPavan Kalyan Tankala, Shubhra Mishra, Satya Lokam, Navin GoyalFirst BabyLM Workshop · KTH Royal Institute of Technology · Microsoft Research (United Kingdom)
    PDF ↗
  4. 2025
    Dual-Space Semantic Synergy Distillation for Continual Learning of Unlabeled StreamsDonghao Sun, Xi Wang, Xu Yang … Cheng DengNeurIPS · Xidian University · ETH Zurich · +2
  5. 2022
    CarM Hierarchical Episodic Memory for Continual LearningSoobee Lee, Minindu Weerakoon, Jonghyun Choi … Myeongjae JeonACM/IEEE Design Automation Conference · Ulsan National Institute of Science and Technology · Yonsei University · +1
  6. 2021
    Lifelong Unsupervised Domain Adaptive Person Re-identification with Coordinated Anti-forgetting and AdaptationZhipeng Huang, Zhizheng Zhang, Cuiling Lan … Zheng-Jun ZhaCVPR · University of Science and Technology of China · Microsoft Research (United Kingdom)
    PDF ↗
  7. 2021
    Carousel Memory: Rethinking the Design of Episodic Memory for Continual LearningSoobee Lee, Minindu Weerakoon, Jonghyun Choi … Myeongjae JeonarXiv · Ulsan National Institute of Science and Technology · Gwangju Institute of Science and Technology · +1
    PDF ↗
  8. 2021
    Omnidirectional Transfer for Quasilinear Lifelong LearningJayanta Dey, Joshua T Vogelstein, Hayden S. Helm … Carey E. PriebeResearch Square · Johns Hopkins University · Baylor College of Medicine · +1
  9. 2021
    Wanderlust: Online Continual Object Detection in the Real WorldJianren Wang, Xin Wang, Yue Shang-Guan, Abhinav GuptaICCV · Carnegie Mellon University · Microsoft Research (United Kingdom) · +1
    PDF ↗
  10. 2021
    Continual Learning in the Teacher-Student Setup: Impact of Task SimilaritySebastian Lee, Sebastian Goldt, Andrew SaxeICML · Microsoft Research (United Kingdom) · Scuola Internazionale Superiore di Studi Avanzati · +1
    PDF ↗
  11. 2020
    Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language ModellingTsendsuren MunkhdalaiarXiv · Microsoft Research (United Kingdom)
    PDF ↗
  12. 2019
    AutoML @ NeurIPS 2018 challenge: Design and ResultsHugo Jair Escalante, Wei-Wei Tu, Isabelle Guyon … Qiang YangMachine Learning · Gleason (United States) · National Institute of Astrophysics, Optics and Electronics · +8
    PDF ↗
  13. 2019
    Large Scale Incremental LearningYue Wu, Yinpeng Chen, Lijuan Wang … Yun FuCVPR · Northeastern University · Universidad del Noreste · +2
    PDF ↗
  14. 2019
    Label Mapping Neural Networks with Response Consolidation for Class Incremental LearningXu Zhang, Yao Yang, Baile Xu … Qingwei LinarXiv · Nanjing University · Microsoft Research (United Kingdom)
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.