Related work

The foundational work on continual learning, 1988 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

12 papers of 7,070Sort Recent · Most cited
  1. 2024
    Overcoming Generic Knowledge Loss with Selective Parameter UpdateWenxuan Zhang, Paul Janson, Rahaf Aljundi, Mohamed ElhoseinyCVPR · Kootenay Association for Science & Technology · King Abdullah University of Science and Technology · +1
    PDF ↗
  2. 2024
    Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained ComputationWenxuan Zhang, Youssef Mohamed, Bernard Ghanem … Mohamed ElhoseinyICLR
    PDF ↗
  3. 2024
    Label Delay in Online Continual LearningBotos Csaba, Wenxuan Zhang, Matthias Müller … Adel BibiNeurIPS
    PDF ↗
  4. 2023
    Label Delay in Continual LearningBotos Csaba, Wenxuan Zhang, Matthias Müller … Adel BibiarXiv
  5. 2022
    A Simple Baseline that Questions the Use of Pretrained-Models in Continual LearningPaul Janson, Wenxuan Zhang, Rahaf Aljundi, Mohamed ElhoseinyarXiv
    PDF ↗
  6. 2020
    Compositional Language Continual LearningYuanpeng Li, Liang Zhao, Kenneth Ward Church, Mohamed ElhoseinyICLR
  7. 2020
    Uncertainty-guided Continual Learning with Bayesian Neural NetworksSayna Ebrahimi, Mohamed Elhoseiny, Trevor Darrell, Marcus RohrbachICLR · University of California, Berkeley · King Abdullah University of Science and Technology · +1
    PDF ↗
  8. 2019
    On Tiny Episodic Memories in Continual LearningArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … M. RanzatoPreprint
  9. 2019
    Continual Learning with Tiny Episodic MemoriesArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … Marc’Aurelio RanzatoarXiv · University of Oxford
    PDF ↗
  10. 2019
    Uncertainty-Guided Continual Learning in Bayesian Neural Networks - Extended AbstractSayna Ebrahimi, Mohamed Elhoseiny, Trevor Darrell, Marcus RohrbachCVPR
  11. 2019
    Efficient Lifelong Learning with A-GEMArslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, Mohamed ElhoseinyICLR
    PDF ↗
  12. 2018
    Memory Aware Synapses: Learning what (not) to forgetRahaf Aljundi, Francesca Babiloni, Mohamed Elhoseiny … Tinne TuytelaarsECCV · IMEC · KU Leuven · +2
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.