Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

617 papers of 8,653 · showing 401–450Sort Recent · Most cited
  1. 2022PDF ↗
  2. 2022
    Continual Learning with Foundation Models: An Empirical Study of Latent ReplayОleksiy Ostapenko, Timothée Lesort, Pau Rodríguez … Laurent CharlinCoLLAs
    PDF ↗
  3. 2022PDF ↗
  4. 2022
    Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic EnvironmentsAbhiram Iyer, Karan Grewal, Akash Velu … Subutai AhmadFrontiers · Carnegie Mellon University · Stanford University · +1
    PDF ↗
  5. 2022
    Progressive Continual Learning for Spoken Keyword SpottingYizheng Huang, Nana Hou, Nancy F. ChenICASSP · Agency for Science, Technology and Research · Institute for Infocomm Research · +1
    PDF ↗
  6. 2022
    From eye-blinks to state construction: Diagnostic benchmarks for online representation learningBanafsheh Rafiee, Zaheer Abbas, Sina Ghiassian … Adam WhiteAdaptive Behavior · University of Alberta · University of Warwick
    PDF ↗
  7. 2022
    Towards Lifelong Learning of Multilingual Text-to-Speech SynthesisMu Yang, Shaojin Ding, Tianlong Chen … Zhangyang WangICASSP · The University of Texas at Dallas · Texas A&M University · +2
    PDF ↗
  8. 2022
    Energy Alignment for Bias Rectification in Class Incremental LearningBowen Zhao, Chen Chen, Xi Xiao … Shu‐Tao XiaICASSP · Tsinghua University · Peng Cheng Laboratory
  9. 2022
    Balanced Ranking and Sorting For Class Incremental Object DetectionBo Cui, Hui Qu, Xuhui Huang, Shan YuICASSP · Chinese Academy of Sciences · Institute of Automation · +4
  10. 2022PDF ↗
  11. 2022
    Stochastic Coherence Over Attention Trajectory For Continuous Learning In Video StreamsMatteo Tiezzi, Simone Marullo, Lapo Faggi … Stefano MelacciIJCAI
    PDF ↗
  12. 2022PDF ↗
  13. 2022
    Unified Question Generation with Continual Lifelong LearningWei Yuan, Hongzhi Yin, Tieke He … Lizhen CuiACM Web Conference 2022 · The University of Queensland · Nanjing University · +2
    PDF ↗
  14. 2022
    ROSE: robust online self-adjusting ensemble for continual learning on imbalanced drifting data streamsAlberto Cano, Bartosz KrawczykMachine Learning · Virginia Commonwealth University
    PDF ↗
  15. 2022
    Continual Learning in Real-Life ApplicationsGabriele Graffieti, Guido Borghi, Davide MaltoniRA-L · University of Bologna
  16. 2022
    What Is Adult Hippocampal Neurogenesis Good for?Gerd KempermannFrontiers · German Center for Neurodegenerative Diseases · Center for Regenerative Therapies Dresden · +1
  17. 2022PDF ↗
  18. 2022
    Experimentally realized memristive memory augmented neural networkRuibin Mao, Bo Wen, Yahui Zhao … Can LiarXiv · University of Hong Kong · University of Notre Dame · +2
    PDF ↗
  19. 2022
    Continual Attentive Fusion for Incremental Learning in Semantic SegmentationGuanglei Yang, Enrico Fini, Dan Xu … Elisa RicciIEEE Trans. Multimedia · University of Trento · Harbin Institute of Technology · +5
    PDF ↗
  20. 2022
    Activity Subspaces in Medial Prefrontal Cortex Distinguish States of the WorldSilvia Maggi, Mark D. HumphriesJournal of Neuroscience · University of Nottingham
  21. 2022
    Dynamic Dialogue Policy for Continual Reinforcement LearningChristian Geishauser, Carel van Niekerk, Nurul Lubis … Milica GašićCOLING
    PDF ↗
  22. 2022
    Forgetting and Imbalance in Robot Lifelong Learning with Off-policy DataWenxuan Zhou, Steven Bohez, Jan Humplik … Nicolas HeessCoLLAs
    PDF ↗
  23. 2022
    DualPrompt: Complementary Prompting for Rehearsal-free Continual LearningZifeng Wang, Zizhao Zhang, Sayna Ebrahimi … Tomas PfisterECCV
    PDF ↗
  24. 2022
    FOSTER: Feature Boosting and Compression for Class-Incremental LearningFuyun Wang, Da-Wei Zhou, Han-Jia Ye, De‐Chuan ZhanECCV
    PDF ↗
  25. 2022
    Information-theoretic Online Memory Selection for Continual LearningShengyang Sun, Daniele Calandriello, Huiyi Hu … Michalis K. TitsiasICLR
    PDF ↗
  26. 2022
    Introducing principles of synaptic integration in the optimization of deep neural networksGiorgia Dellaferrera, Stanisław Woźniak, Giacomo Indiveri … Evangelos EleftheriouNature Communications · University of Zurich · IBM Research - Zurich · +3
  27. 2022
    Efficient Test-Time Model Adaptation without ForgettingShuaicheng Niu, Jiaxiang Wu, Yifan Zhang … Mingkui TanICML
    PDF ↗
  28. 2022
    Revisiting a kNN-based Image Classification System with High-capacity StorageKengo Nakata, Youyang Ng, Daisuke Miyashita … Jun DeguchiECCV
    PDF ↗
  29. 2022PDF ↗
  30. 2022PDF ↗
  31. 2022
    Gradient-Matching Coresets for Rehearsal-Based Continual LearningLukas Balles, Giovanni Zappella, Cédric ArchambeauarXiv
    PDF ↗
  32. 2022
    Stable Lifelong Learning: Spiking neurons as a solution to instability in plastic neural networksSamuel Schmidgall, Joe HaysNeuro-Inspired Computational Elements Conference · United States Naval Research Laboratory
    PDF ↗
  33. 2022PDF ↗
  34. 2022
    Continual Learning and Private UnlearningBo Liu, Qiang Liu, Peter StoneCoLLAs
    PDF ↗
  35. 2022PDF ↗
  36. 2022
    Is Class-Incremental Enough for Continual Learning?Andrea Cossu, Gabriele Graffieti, Lorenzo Pellegrini … Vincenzo LomonacoFrontiers · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  37. 2022
    Addressing Client Drift in Federated Continual Learning with Adaptive OptimizationYeshwanth Venkatesha, Youngeun Kim, Hyoungseob Park … Priyadarshini PandaarXiv
    PDF ↗
  38. 2022
    Tackling Online One-Class Incremental Learning by Removing Negative ContrastsNader Asadi, Sudhir P. Mudur, Eugene BelilovskyarXiv
    PDF ↗
  39. 2022
    Biological underpinnings for lifelong learning machinesDhireesha Kudithipudi, Mario Aguilar-Simon, Jonathan Babb … Hava T. SiegelmannNature Machine Intelligence · The University of Texas at San Antonio · Intelligent Systems Research (United States) · +24
    PDF ↗
  40. 2022
    The Challenges of Continuous Self-Supervised LearningSenthil Purushwalkam, Pedro Morgado, Abhinav GuptaECCV
    PDF ↗
  41. 2022
    Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with MomentumKirby Banman, Liam Peet-Pare, Nidhi Hegde … Martha WhiteICLR
    PDF ↗
  42. 2022
    Online Continual Learning for Embedded DevicesTyler L. Hayes, Christopher KananCoLLAs
    PDF ↗
  43. 2022
    Multi-Domain Response Generation Using Memory-Replay Continual LearningHyeong-Jun Park, Choong Seon Hong, Seong-Bae Park, Hyun-Je Song정보과학회 컴퓨팅의 실제 논문지
  44. 2022PDF ↗
  45. 2022
    A Closer Look at Knowledge Distillation with Features, Logits, and GradientsYen-Chang Hsu, James Smith, Yilin Shen … Hongxia JinarXiv
    PDF ↗
  46. 2022
    ConTinTin: Continual Learning from Task InstructionsWenpeng Yin, Jia Li, Caiming XiongACL
    PDF ↗
  47. 2022PDF ↗
  48. 2022
    L2Explorer: A Lifelong Reinforcement Learning Assessment EnvironmentErik C. Johnson, Eric Q. Nguyen, Blake A. Schreurs … Gautam K. VallabhaarXiv
    PDF ↗
  49. 2022
    XST: A Crossbar Column-wise Sparse Training for Efficient Continual LearningFan Zhang, Yang Li, Jian Meng … Deliang FanDesign, Automation & Test in Europe Conference &… · Arizona State University
  50. 2022
    Continual Prompt Tuning for Dialog State TrackingQi Zhu, Bing Li, Fei Mi … Minlie HuangACL
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.