Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

17 papers of 11,817Sort Recent · Most cited
  1. 2017PDF ↗
  2. 2017
    Gradual Tuning: a better way of Fine Tuning the parameters of a Deep Neural NetworkGuglielmo Montone, J. Kevin Ο’Regan, Alexander V. TerekhovarXiv
    PDF ↗
  3. 2017
    Block Neural Network Avoids Catastrophic Forgetting When Learning Multiple TaskGuglielmo Montone, J. Kevin Ο’Regan, Alexander V. TerekhovarXiv
    PDF ↗
  4. 2017PDF ↗
  5. 2017PDF ↗
  6. 2017PDF ↗
  7. 2017PDF ↗
  8. 2017PDF ↗
  9. 2017
    Continual Learning in Generative Adversarial NetsAri Seff, Alex Beatson, Daniel Suo, Han LiuarXiv · Princeton University
    PDF ↗
  10. 2017
    A Strategy for an Uncompromising Incremental LearnerRagav Venkatesan, Hemanth Venkateswara, Sethuraman Panchanathan, Baoxin LiarXiv
    PDF ↗
  11. 2017PDF ↗
  12. 2017
    Pseudorehearsal in actor-critic agentsVladimir Marochko, Leonard Johard, Manuel MazzaraarXiv
    PDF ↗
  13. 2017PDF ↗
  14. 2017
    Improved multitask learning through synaptic intelligenceFriedemann Zenke, Ben Poole, Surya GanguliarXiv · Stanford University
    PDF ↗
  15. 2017
    Generative and Discriminative Text Classification with Recurrent Neural NetworksDani Yogatama, Chris Dyer, Ling Wang, Phil BlunsomarXiv · Baidu (China) · Carnegie Mellon University · +1
    PDF ↗
  16. 2017
    PathNet: Evolution Channels Gradient Descent in Super Neural NetworksChrisantha Fernando, Dylan Banarse, Charles Blundell … Daan WierstraarXiv
    PDF ↗
  17. 2017PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.