Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

13 papers of 11,817Sort Recent · Most cited
  1. 2021
    Proving Theorems using Incremental Learning and Hindsight Experience ReplayEser Aygün, Laurent Orseau, Ankit Anand … Shibl MouradICML
    PDF ↗
  2. 2021
    Controlling Conditional Language Models without Catastrophic ForgettingTomasz Korbak, Hady Elsahar, Germán Kruszewski, Marc DymetmanICML
    PDF ↗
  3. 2021
    Incremental Learning Vector Auto Regression for Forecasting with Edge DevicesVenkata Pesala, Topon Kumar Paul, Ken Ueno … Ankit KesarwaniICML · Toshiba (Japan)
  4. 2021
    Impact of reverberation through deep neural networks on adversarial perturbationsRomain Cohendet, M. Solinas, Rémi Bernhard … Martial MermillodICML · Laboratoire d'Intégration des Systèmes et des Technologies · Université Grenoble Alpes
  5. 2021
    Wide Neural Networks Forget Less CatastrophicallySeyed Iman Mirzadeh, Arslan Chaudhry, Yin, Dong … Mehrdad FarajtabarICML · Google (United States)
    PDF ↗
  6. 2021
    Kernel Continual LearningMahammad Mahdi Derakhshani, Xiantong Zhen, Ling Shao, Cees G. M. SnoekICML · University of Amsterdam · Inception Institute of Artificial Intelligence
    PDF ↗
  7. 2021
    Continual Learning in the Teacher-Student Setup: Impact of Task SimilaritySebastian Lee, Sebastian Goldt, Andrew SaxeICML · Microsoft Research (United Kingdom) · Scuola Internazionale Superiore di Studi Avanzati · +1
    PDF ↗
  8. 2021
    Continuous Coordination As a Realistic Scenario for Lifelong LearningHadi Nekoei, Akilesh Badrinaaraayanan, Aaron Courville, Sarath ChandarICML · Centre Universitaire de Mila · Université de Montréal · +1
    PDF ↗
  9. 2021
    Cross-Gradient Aggregation for Decentralized Learning from Non-IID dataYasaman Esfandiari, Sin Yong Tan, Zhanhong Jiang … Soumik SarkarICML · Iowa State University · Johnson Controls (Switzerland) · +3
    PDF ↗
  10. 2021PDF ↗
  11. 2021
    GP-Tree: A Gaussian Process Classifier for Few-Shot Incremental LearningIdan Achituve, Aviv Navon, Yochai Yemini … Ethan FetayaICML · Bar-Ilan University
    PDF ↗
  12. 2021
    Online Limited Memory Neural-Linear Bandits with Likelihood MatchingOfir Nabati, Tom Zahavy, Shie MannorICML · Technion – Israel Institute of Technology · Google DeepMind (United Kingdom)
    PDF ↗
  13. 2021
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.