Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

1,587 papers of 4,574 · showing 1551–1587Sort Recent · Most cited
  1. 2018
    Evaluating and Characterizing Incremental Learning from Non-Stationary DataAlejandro Cervantes, Christian Gagné, Pedro Isasi, Marc ParizeauarXiv
    PDF ↗
  2. 2018
    Meta Continual LearningRisto Vuorio, Dong-Yeon Cho, Daejoong Kim, Jiwon KimarXiv
    PDF ↗
  3. 2018PDF ↗
  4. 2018PDF ↗
  5. 2018
    One Big Net For EverythingJuergen SchmidhuberarXiv
    PDF ↗
  6. 2018
    Unicorn: Continual Learning with a Universal, Off-policy AgentDaniel J. Mankowitz, Augustin Žídek, André Barreto … Tom SchaularXiv
    PDF ↗
  7. 2018
    Pseudo-Recursal: Solving the Catastrophic Forgetting Problem in Deep Neural NetworksCraig Atkinson, Brendan McCane, Lech Szymanski, Anthony RobinsarXiv
    PDF ↗
  8. 2018
    Incremental Classifier Learning with Generative Adversarial NetworksYue Wu, Yinpeng Chen, Lijuan Wang … Yun FuarXiv
    PDF ↗
  9. 2017PDF ↗
  10. 2017
    Gradual Tuning: a better way of Fine Tuning the parameters of a Deep Neural NetworkGuglielmo Montone, J. Kevin Ο’Regan, Alexander V. TerekhovarXiv
    PDF ↗
  11. 2017
    Block Neural Network Avoids Catastrophic Forgetting When Learning Multiple TaskGuglielmo Montone, J. Kevin Ο’Regan, Alexander V. TerekhovarXiv
    PDF ↗
  12. 2017PDF ↗
  13. 2017PDF ↗
  14. 2017PDF ↗
  15. 2017PDF ↗
  16. 2017
    Continual Learning in Generative Adversarial NetsAri Seff, Alex Beatson, Daniel Suo, Han LiuarXiv · Princeton University
    PDF ↗
  17. 2017
    A Strategy for an Uncompromising Incremental LearnerRagav Venkatesan, Hemanth Venkateswara, Sethuraman Panchanathan, Baoxin LiarXiv
    PDF ↗
  18. 2017PDF ↗
  19. 2017
    Improved multitask learning through synaptic intelligenceFriedemann Zenke, Ben Poole, Surya GanguliarXiv · Stanford University
    PDF ↗
  20. 2017
    Generative and Discriminative Text Classification with Recurrent Neural NetworksDani Yogatama, Chris Dyer, Ling Wang, Phil BlunsomarXiv · Baidu (China) · Carnegie Mellon University · +1
    PDF ↗
  21. 2017
    PathNet: Evolution Channels Gradient Descent in Super Neural NetworksChrisantha Fernando, Dylan Banarse, Charles Blundell … Daan WierstraarXiv
    PDF ↗
  22. 2016
    A Growing Long-term Episodic & Semantic MemoryMarc Pickett, Rami Al‐Rfou, Louis Shao, Chris TararXiv
    PDF ↗
  23. 2016
    Incremental One-Class Models for Data ClassificationTakoua Kefi, Riadh Ksantini, Mohamed Kaâniche, Adel BouhoulaarXiv
    PDF ↗
  24. 2016PDF ↗
  25. 2016
    Less-forgetting Learning in Deep Neural NetworksHeechul Jung, Jeongwoo Ju, Minju Jung, Junmo KimarXiv
    PDF ↗
  26. 2016
    Progressive Neural NetworksAndrei A. Rusu, Neil C. Rabinowitz, Guillaume Desjardins … Raia HadsellarXiv
    PDF ↗
  27. 2016
    Active Long Term Memory NetworksTommaso Furlanello, Jiaping Zhao, Andrew Saxe … Bosco S. TjanarXiv
    PDF ↗
  28. 2016
    One-shot Learning with Memory-Augmented Neural NetworksAdam Santoro, Sergey Bartunov, Matthew Botvinick … Timothy LillicraparXiv
    PDF ↗
  29. 2016
    Incremental Object Recognition in Robotics with Extension to New Classes in Constant TimeR. Camoriano, Giulia Pasquale, C. Ciliberto … G. MettaarXiv
    PDF ↗
  30. 2016
    Online Open World RecognitionRocco De Rosa, Thomas Mensink, Barbara CaputoarXiv
    PDF ↗
  31. 2015PDF ↗
  32. 2015
    Dual Memory Architectures for Fast Deep Learning of Stream Data via an Online-Incremental-Transfer StrategySang-Woo Lee, Min-Oh Heo, Jiwon Kim … Byoung‐Tak ZhangarXiv · Seoul National University
    PDF ↗
  33. 2015PDF ↗
  34. 2014
    Learning to see like children: proof of conceptMarco Gori, Marco Lippi, Marco Maggini, Stefano MelacciarXiv
    PDF ↗
  35. 2014
    Representation as a ServiceOuais Alsharif, Philip Bachman, Joëlle PineauarXiv
    PDF ↗
  36. 2013
    Clustering Markov Decision Processes For Continual TransferMaqsood Mahmud, Majd Hawasly, Benjamin Rosman, Subramanian RamamoorthyarXiv
    PDF ↗
  37. 2007PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.