Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

51 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2018
    Continual Match Based Training in Pommerman: Technical ReportPeng Peng, Liang Pang, Yufeng Yuan, Chao GaoarXiv
    PDF ↗
  2. 2018PDF ↗
  3. 2018
    Continual Learning Augmented Investment DecisionsDaniel Philps, Tillman Weyde, Artur d’Avila Garcez, Roy BatchelorarXiv · City, University of London
    PDF ↗
  4. 2018
    Overcoming Catastrophic Forgetting by Soft Parameter PruningJian Peng, Hao, Jiang, Zhuo Li … Haifeng LiarXiv
    PDF ↗
  5. 2018
    Few-Shot Self Reminder to Overcome Catastrophic ForgettingJunfeng Wen, Yanshuai Cao, Ruitong HuangarXiv
    PDF ↗
  6. 2018
    Partitioned Variational Inference: A unified framework encompassing federated and continual learningThang D. Bui, Cuong V. Nguyen, Siddharth Swaroop, Richard E. TurnerarXiv
    PDF ↗
  7. 2018
    Generative Adversarial Network Training is a Continual Learning ProblemKevin J Liang, Chunyuan Li, Guoyin Wang, Lawrence CarinarXiv
    PDF ↗
  8. 2018
    Revisiting Pre-training: An Efficient Training Method for Image Classification.Bowen Cheng, Yunchao Wei, Jiahui Yu … Humphrey ShiarXiv
    PDF ↗
  9. 2018
    The Barbados 2018 List of Open Issues in Continual LearningTom Schaul, Hado van Hasselt, Joseph Modayil … Doina PrecuparXiv
    PDF ↗
  10. 2018
    Transfer Learning from LDA to BiLSTM-CNN for Offensive Language Detection in TwitterGregor Wiedemann, Eugen Ruppert, Raghav Jindal, Chris BiemannarXiv
    PDF ↗
  11. 2018
    On the role of neurogenesis in overcoming catastrophic forgettingGerman I. Parisi, Xu Ji, Stefan WermterarXiv
    PDF ↗
  12. 2018
    Closed-Loop GAN for continual LearningAmanda Rios, Laurent IttiarXiv · University of Southern California · California Southern University
    PDF ↗
  13. 2018
    Don't forget, there is more than forgetting: new metrics for Continual LearningNatalia Díaz-Rodríguez, Vincenzo Lomonaco, David Filliat, Davide MaltoniarXiv · Laboratoire d’Informatique et Systèmes · University of Bologna
    PDF ↗
  14. 2018
    Re-evaluating Continual Learning Scenarios: A Categorization and Case for Strong BaselinesYen-Chang Hsu, Yen‐Cheng Liu, Ramasamy, Anita, Kira, ZsoltarXiv · Georgia Institute of Technology
    PDF ↗
  15. 2018
    Self-Supervised GAN to Counter ForgettingTing Chen, Xiaohua Zhai, Neil HoulsbyarXiv
    PDF ↗
  16. 2018
    Reconciling $\lambda$-Returns with Experience ReplayBrett Daley, Christopher AmatoarXiv
    PDF ↗
  17. 2018PDF ↗
  18. 2018PDF ↗
  19. 2018
    Continual State Representation Learning for Reinforcement Learning using Generative ReplayHugo Caselles-Dupré, M. Ortíz, David FilliatarXiv · Laboratoire d’Informatique et Systèmes · SoftBank Robotics (France)
    PDF ↗
  20. 2018
    Generative replay with feedback connections as a general strategy for continual learningGido M. van de Ven, Andreas S. ToliasarXiv · Baylor College of Medicine
    PDF ↗
  21. 2018
    Autonomous Deep Learning: Incremental Learning of Denoising Autoencoder for Evolving Data StreamsMahardhika Pratama, Andri Ashfahani, Yew-Soon Ong … Edwin LughoferarXiv
    PDF ↗
  22. 2018
    Abstraction LearningFeiqi Deng, Jinsheng Ren, Feng ChenarXiv
    PDF ↗
  23. 2018
  24. 2018PDF ↗
  25. 2018PDF ↗
  26. 2018
    On the Decision Boundary of Deep Neural NetworksLi Yu, Lizhong Ding, Xin GaoarXiv · King Abdullah University of Science and Technology
    PDF ↗
  27. 2018PDF ↗
  28. 2018
    Local learning rules to attenuate forgetting in neural networksMichael Deistler, Martino Sorbaro, Michael E. Rule, Matthias H. HennigarXiv
    PDF ↗
  29. 2018
    On catastrophic forgetting and mode collapse in Generative Adversarial NetworksHoang Thanh-Tung, Truyen TranarXiv · Deakin University
    PDF ↗
  30. 2018PDF ↗
  31. 2018PDF ↗
  32. 2018
    Evaluating and Characterizing Incremental Learning from Non-Stationary DataAlejandro Cervantes, Christian Gagné, Pedro Isasi, Marc ParizeauarXiv
    PDF ↗
  33. 2018
    Meta Continual LearningRisto Vuorio, Dong-Yeon Cho, Daejoong Kim, Jiwon KimarXiv
    PDF ↗
  34. 2018PDF ↗
  35. 2018
    Concept-Oriented Deep LearningDaniel T. ChangarXiv
    PDF ↗
  36. 2018PDF ↗
  37. 2018
    Sample Reuse via Importance Sampling in Information Geometric OptimizationShinichi Shirakawa, Youhei Akimoto, Kazuki Ouchi, Kouzou OharaarXiv
    PDF ↗
  38. 2018
  39. 2018PDF ↗
  40. 2018
    Incremental Learning Framework Using Cloud ComputingKumarjit Pathak, G Prabhukiran, Jitin Kapila, Nikit GawandearXiv
    PDF ↗
  41. 2018PDF ↗
  42. 2018
    Scalable Deep Learning Logo DetectionHang Su, Shaogang Gong, Xiatian ZhuarXiv
    PDF ↗
  43. 2018
  44. 2018PDF ↗
  45. 2018
    One Big Net For EverythingJuergen SchmidhuberarXiv
    PDF ↗
  46. 2018
    Unicorn: Continual Learning with a Universal, Off-policy AgentDaniel J. Mankowitz, Augustin Žídek, André Barreto … Tom SchaularXiv
    PDF ↗
  47. 2018
  48. 2018
    Pseudo-Recursal: Solving the Catastrophic Forgetting Problem in Deep Neural NetworksCraig Atkinson, Brendan McCane, Lech Szymanski, Anthony RobinsarXiv
    PDF ↗
  49. 2018
    Incremental Classifier Learning with Generative Adversarial NetworksYue Wu, Yinpeng Chen, Lijuan Wang … Yun FuarXiv
    PDF ↗
  50. 2018PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.