Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

30 papers of 11,817Sort Recent · Most cited
  1. 2022
    CL-Cross VQA: A Continual Learning Benchmark for Cross-Domain Visual Question AnsweringYao Zhang, Haokun Chen, Ahmed Frikha … Volker TrespWACV · LMU Klinikum · Ludwig-Maximilians-Universität München · +1
    PDF ↗
  2. 2022
    SimCS: Simulation for Domain Incremental Online Continual SegmentationMotasem Alfarra, Zhipeng Cai, Adel Bibi … Matthias MüllerAAAI · Intel (United States) · King Abdullah University of Science and Technology · +1
    PDF ↗
  3. 2022
    SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural RepresentationsXingguang Zhong, Yue Pan, Jens Behley, Cyrill StachnissICRA · University of Bonn · University of Oxford · +1
    PDF ↗
  4. 2022
    Continual task learning in natural and artificial agentsTimo Flesch, Andrew Saxe, Christopher SummerfieldTrends in Neurosciences · University of Oxford · Sainsbury Laboratory · +3
    PDF ↗
  5. 2022
    Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signalsTimo Flesch, Dávid Nagy, Andrew Saxe, Christopher SummerfieldPLOS · University of Oxford · HUN-REN Wigner Research Centre for Physics · +5
    PDF ↗
  6. 2021
    Same State, Different Task: Continual Reinforcement Learning without InterferenceSamuel Kessler, Jack Parker-Holder, Philip Ball … Stephen RobertsAAAI · University of Oxford
    PDF ↗
  7. 2021
    Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental LearningYujun Shi, Kuangqi Zhou, Jian Liang … Vincent Y. F. TanCVPR · National University of Singapore · Chinese Academy of Sciences · +1
    PDF ↗
  8. 2021
    An Adapter Based Pre-Training for Efficient and Scalable Self-Supervised Speech Representation LearningSamuel Kessler, Bethan Thomas, Salah KaroutICASSP · University of Oxford · Huawei Technologies (United Kingdom)
    PDF ↗
  9. 2021
    Continual Learning in the Teacher-Student Setup: Impact of Task SimilaritySebastian Lee, Sebastian Goldt, Andrew SaxeICML · Microsoft Research (United Kingdom) · Scuola Internazionale Superiore di Studi Avanzati · +1
    PDF ↗
  10. 2019
    Using Hindsight to Anchor Past Knowledge in Continual LearningArslan Chaudhry, Albert Gordo, Puneet K. Dokania … David López-PazAAAI · University of Oxford · Meta (Israel)
    PDF ↗
  11. 2021
    Wing plasticity and associated gene expression varies across the pea aphid biotype complexBenjamin J. Parker, Rose M. H. Driscoll, Mary E. Grantham … Jennifer A. BrissonEvolution · University of Oxford · University of Rochester · +4
  12. 2021
    Sustainable Artificial Intelligence through Continual LearningAndrea Cossu, Marta Ziosi, Vincenzo LomonacoInternational Conference on AI for People: Towards Sustai… · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  13. 2021
    Contrastive Representations for Continual Learning of Fine-Grained Histology ImagesTapabrata Chakraborti, Fergus Gleeson, Jens RittscherSpringer LNCS · University of Oxford
  14. 2020
    Classification of PBMC cell types using scRNAseq, ANN, and incremental learningJiahui Zhong, Razin A. Shaikh, Haoguo WU … Vladimir BrusićIEEE International Conference on Bioinformatics and Biome… · University of Nottingham Ningbo China · University of Oxford · +5
  15. 2020
    Neural inhibition for continual learning and memoryHelen C. BarronCurrent Opinion in Neurobiology · John Radcliffe Hospital · University of Oxford · +3
  16. 2020
    Continual Learning in Low-rank Orthogonal SubspacesArslan Chaudhry, Naeemullah Khan, Puneet K. Dokania, Philip H. S. TorrNeurIPS · University of Oxford
    PDF ↗
  17. 2020
    GDumb: A Simple Approach that Questions Our Progress in Continual LearningAmeya Prabhu, Philip H. S. Torr, Puneet K. DokaniaSpringer LNCS · University of Oxford
  18. 2019
    Hierarchical Indian buffet neural networks for Bayesian continual learningSamuel Kessler, Vu Nguyen, Stefan Zohren, Stephen RobertsUAI · University of Oxford · Science Oxford
    PDF ↗
  19. 2019
    Continual Unsupervised Representation LearningDushyant Rao, Francesco Visin, Andrei Rusu … Raia HadsellNeurIPS · Carnegie Mellon University · Google (United States) · +2
    PDF ↗
  20. 2019
    Continual Learning with Tiny Episodic MemoriesArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … Marc’Aurelio RanzatoarXiv · University of Oxford
    PDF ↗
  21. 2018
    A Unifying Bayesian View of Continual LearningSebastian Farquhar, Yarin GalNeurIPS · University of Oxford
    PDF ↗
  22. 2019
    Differentially Private Continual LearningSebastian Farquhar, Yarin GalarXiv · University of Oxford
    PDF ↗
  23. 2018
    Comparing continual task learning in minds and machinesTimo Flesch, Jan Balaguer, Ronald Dekker … Christopher SummerfieldPNAS · University of Oxford · Google DeepMind (United Kingdom)
  24. 2017
    Trial without Error: Towards Safe Reinforcement Learning via Human InterventionWilliam S. Saunders, Girish Sastry, Andreas Stuhlmüller, Owain EvansAdaptive Agents and Multi-Agent Systems · University of Oxford · Stanford University
    PDF ↗
  25. 2019
    Towards Robust Evaluations of Continual LearningSebastian Farquhar, Yarin GalICML · University of Oxford
    PDF ↗
  26. 2018
    Riemannian Walk for Incremental Learning: Understanding Forgetting and IntransigenceArslan Chaudhry, Puneet K. Dokania, Thalaiyasingam Ajanthan, Philip H. S. TorrSpringer LNCS · University of Oxford
    PDF ↗
  27. 2012
    Semantic categorization of outdoor scenes with uncertainty estimates using multi-class gaussian process classificationRohan Paul, Rudolph Triebel, Daniela Rus, Paul NewmanIROS · Oxford Research Group · University of Oxford · +1
  28. 2008
    Learning an Alphabet of Shape and Appearance for Multi-Class Object DetectionAndreas Opelt, Axel Pinz, Andrew ZissermanInternational Journal of Computer Vision · Graz University of Technology · University of Oxford
  29. 2004
    Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object CategoriesLi Fei-Fei, Rob Fergus, Pietro PeronaComputer Vision and Image Understanding · Princeton University · University of Oxford · +1
  30. 2006
    Incremental learning of object detectors using a visual shape alphabetAndreas Opelt, Axel Pinz, Andrew ZissermanCVPR · Graz University of Technology · University of Oxford
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.