Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

24 papers of 11,817Sort Recent · Most cited
  1. 2026
    Dynamic Mixture of Latent Memories for Self-Evolving AgentsDianzhi Yu, Vireo Zhang, Hongru Wang … Irwin KingarXiv
    PDF ↗
  2. 2025
    Unforgotten Safety: Preserving Safety Alignment of Large Language Models with Continual LearningLama Alssum, Hani Itani, Hasan Abed Al Kader Hammoud … Bernard GhanemarXiv
    PDF ↗
  3. 2024
    Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained ComputationWenxuan Zhang, Youssef Mohamed, Bernard Ghanem … Mohamed ElhoseinyICLR
    PDF ↗
  4. 2024
    kNN-CLIP: Retrieval Enables Training-Free Segmentation on Continually Expanding Large VocabulariesZhongrui Gui, Shuyang Sun, Runjia Li … Philip H. S. TorrTrans. Mach. Learn. Res.
    PDF ↗
  5. 2024
    RanDumb: Random Representations Outperform Online Continually Learned RepresentationsAmeya Prabhu, Shiven Sinha, P. Kumaraguru … P. DokaniaNeurIPS
    PDF ↗
  6. 2024
    Label Delay in Online Continual LearningBotos Csaba, Wenxuan Zhang, Matthias Müller … A. BibiNeurIPS
    PDF ↗
  7. 2023
    From Categories to Classifiers: Name-Only Continual Learning by Exploring the WebAmeya Prabhu, Hasan Hammoud, S. Lim … Adel BibiCoLLAs
    PDF ↗
  8. 2023
    Fine-tuning can cripple your foundation model; preserving features may be the solutionJishnu Mukhoti, Y. Gal, Philip H. S. Torr, P. DokaniaTrans. Mach. Learn. Res.
    PDF ↗
  9. 2023PDF ↗
  10. 2023
    Online Continual Learning Without the Storage ConstraintAmeya Prabhu, Zhipeng Cai, P. Dokania … Ozan SenerarXiv
    PDF ↗
  11. 2023
    Rapid Adaptation in Online Continual Learning: Are We Evaluating It Right?Hasan Hammoud, Ameya Prabhu, S. Lim … Bernard GhanemICCV
    PDF ↗
  12. 2023
    Computationally Budgeted Continual Learning: What Does Matter?Ameya Prabhu, Hasan Hammoud, P. Dokania … Adel BibiCVPR
    PDF ↗
  13. 2023PDF ↗
  14. 2023
    Real-Time Evaluation in Online Continual Learning: A New HopeYasir Ghunaim, Adel Bibi, K. Alhamoud … Bernard GhanemCVPR
    PDF ↗
  15. 2023
    Real-Time Evaluation in Online Continual Learning: A New ParadigmYasir Ghunaim, Adel Bibi, K. Alhamoud … Bernard GhanemarXiv
  16. 2023
    From Categories to Classifier: Name-Only Continual Learning by Exploring the WebAmeya Prabhu, Hasan Abed Al Kader Hammoud, Ser-Nam Lim … Adel BibiarXiv
  17. 2023
    Label Delay in Continual LearningBotos Csaba, Wenxuan Zhang, Matthias Müller … Adel BibiarXiv
  18. 2021
    Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental LearningYujun Shi, Kuangqi Zhou, Jian Liang … Vincent Y. F. TanCVPR · National University of Singapore · Chinese Academy of Sciences · +1
    PDF ↗
  19. 2019
    Using Hindsight to Anchor Past Knowledge in Continual LearningArslan Chaudhry, Albert Gordo, Puneet K. Dokania … David López-PazAAAI · University of Oxford · Meta (Israel)
    PDF ↗
  20. 2020
    Continual Learning in Low-rank Orthogonal SubspacesArslan Chaudhry, Naeemullah Khan, Puneet K. Dokania, Philip H. S. TorrNeurIPS · University of Oxford
    PDF ↗
  21. 2020
    GDumb: A Simple Approach that Questions Our Progress in Continual LearningAmeya Prabhu, Philip H. S. Torr, Puneet K. DokaniaSpringer LNCS · University of Oxford
  22. 2019
    On Tiny Episodic Memories in Continual LearningArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … M. RanzatoPreprint
  23. 2019
    Continual Learning with Tiny Episodic MemoriesArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … Marc’Aurelio RanzatoarXiv · University of Oxford
    PDF ↗
  24. 2018
    Riemannian Walk for Incremental Learning: Understanding Forgetting and IntransigenceArslan Chaudhry, Puneet K. Dokania, Thalaiyasingam Ajanthan, Philip H. S. TorrSpringer LNCS · University of Oxford
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.