Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

71 papers of 8,653 · showing 51–71Sort Recent · Most cited
  1. 2022PDF ↗
  2. 2022
    Interpolating Compressed Parameter SubspacesSiddhartha Datta, Nigel ShadboltarXiv
    PDF ↗
  3. 2022
    Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node ActivationSebastian Lee, Stefano Sarao Mannelli, Claudia Clopath … Andrew SaxearXiv
    PDF ↗
  4. 2022PDF ↗
  5. 2022
    Experimentally realized memristive memory augmented neural networkRuibin Mao, Bo Wen, Yahui Zhao … Can LiarXiv · University of Hong Kong · University of Notre Dame · +2
    PDF ↗
  6. 2022
    Gradient-Matching Coresets for Rehearsal-Based Continual LearningLukas Balles, Giovanni Zappella, Cédric ArchambeauarXiv
    PDF ↗
  7. 2022
    Addressing Client Drift in Federated Continual Learning with Adaptive OptimizationYeshwanth Venkatesha, Youngeun Kim, Hyoungseob Park … Priyadarshini PandaarXiv
    PDF ↗
  8. 2022
    Tackling Online One-Class Incremental Learning by Removing Negative ContrastsNader Asadi, Sudhir P. Mudur, Eugene BelilovskyarXiv
    PDF ↗
  9. 2022
    A Closer Look at Knowledge Distillation with Features, Logits, and GradientsYen-Chang Hsu, James Smith, Yilin Shen … Hongxia JinarXiv
    PDF ↗
  10. 2022
    L2Explorer: A Lifelong Reinforcement Learning Assessment EnvironmentErik C. Johnson, Eric Q. Nguyen, Blake A. Schreurs … Gautam K. VallabhaarXiv
    PDF ↗
  11. 2022
    Provable and Efficient Continual Representation LearningYingcong Li, Mingchen Li, M. Salman Asif, Samet OymakarXiv
    PDF ↗
  12. 2022
    A Versatile Agent for Fast Learning from Human InstructorsYiwen Chen, Zedong Zhang, Haofeng Liu … Marcelo H. AngarXiv
    PDF ↗
  13. 2022
    BERT WEAVER: Using WEight AVERaging to Enable Lifelong Learning for Transformer-based ModelsKühnel, Lisa, Alexander Schulz, Barbara Hammer, Juliane FluckarXiv
    PDF ↗
  14. 2022
    Diagnosing Batch Normalization in Class Incremental LearningMinghao Zhou, Quanziang Wang, Jun Shu … Deyu MengarXiv
    PDF ↗
  15. 2022PDF ↗
  16. 2022PDF ↗
  17. 2022PDF ↗
  18. 2022
    Architecture Matters in Continual LearningSeyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin … Mehrdad FarajtabararXiv
    PDF ↗
  19. 2022
    Lifelong Generative Learning via Knowledge ReconstructionLibo Huang, Zhulin An, Xiang Zhi, Yongjun XuarXiv
    PDF ↗
  20. 2022PDF ↗
  21. 2022PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.