Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

32 papers of 11,817Sort Recent · Most cited
  1. 2019
    Attacking Lifelong Learning Models with Gradient ReversionYunhui Guo, Mingrui Liu, Yandong Li … Tajana RosingPreprint
  2. 2019
  3. 2019
  4. 2019
  5. 2019
    Overcoming Catastrophic Forgetting via Hessian-free Curvature EstimatesLeonid Butyrev, G. Kontes, Christoffer Loeffler, Christopher MutschlerPreprint
  6. 2019
  7. 2019
    Continual Learning with Delayed FeedbackTheivendiram Pranavan, Terence SimPreprint
  8. 2019
    Differentiable Hebbian Consolidation for Continual LearningVithursan Thangarasa, Thomas Miconi, Graham W. TaylorPreprint
  9. 2019
    HIPPOCAMPAL NEURONAL REPRESENTATIONS IN CONTINUAL LEARNINGS. Mohinta, R. P. Costa, Stéphane CiocchiPreprint
  10. 2019
    Minimizing Change in Classifier Likelihood to Mitigate Catastrophic ForgettingAshish Gaurav, Sachin Vernekar, Sean Sedwards … K. CzarneckiPreprint
  11. 2019
    Prototype Recalls for Continual LearningMengmi Zhang, Tao Wang, J. Lim, Jiashi FengPreprint
  12. 2019
    Task-agnostic Continual Learning via Growing Long-Term Memory NetworksGermán Kruszewski, Ionut-Teodor Sorodoc, Tomas MikolovPreprint
  13. 2019
    Scalable and Order-robust Continual Learning with Hierarchically Decomposed Networks.J. Kirkpatrick, Razvan Pascanu, Neil C. Rabinowitz … Guillaume DesjardinsPreprint
  14. 2019
  15. 2019
  16. 2019
    Continual Learning Using World Models for Pseudo-RehearsalNicholas A. Ketz, Soheil Kolouri, Praveen K. PillyPreprint
  17. 2019
    On Tiny Episodic Memories in Continual LearningArslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny … M. RanzatoPreprint
  18. 2019
    Functional Regularisation for Continual LearningMichalis K. Titsias, Jonathan Schwarz, A. G. Matthews … Y. TehPreprint
  19. 2019
    Differentiable Hebbian Plasticity for Continual LearningVithursan Thangarasa, Thomas Miconi, Graham W. TaylorPreprint
  20. 2019
    Meta-analysis of Continual LearningCuong V Nguyen, A. Achille, Michael Lam … Stefano SoattoPreprint
  21. 2019
  22. 2019
  23. 2019
  24. 2019
    Avoiding Catastrophic Forgetting in Safety GridworldCarl Edwards, Brandon MathisPreprint
  25. 2019
  26. 2019
  27. 2019
    Efficient Continual Learning with Latent RehearsalGabriele Graffieti, Lorenzo Pellegrini, V. Lomonaco, D. MaltoniPreprint
  28. 2019
  29. 2019
  30. 2019
  31. 2019
    Task-Free Continual Learning Supplementary MaterialsRahaf Aljundi, Klaas KelchtermansPreprint
  32. 2019
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.