Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3101–3150Sort Recent · Most cited
  1. 2023
    Generative Replay Inspired by Hippocampal Memory Indexing for Continual Language LearningAru Maekawa, Hidetaka Kamigaito, Kotaro Funakoshi, Manabu OkumuraEACL · Tokyo Institute of Technology · Nara Institute of Science and Technology
    PDF ↗
  2. 2023
    Replay to Remember: Continual Layer-Specific Fine-tuning for German Speech RecognitionTheresa Pekarek Rosin, Stefan WermterSpringer LNCS · Universität Hamburg · Hamburg University of Technology
    PDF ↗
  3. 2023
    Self-Organizing Multiple Readouts for Reservoir ComputingYuichiro Tanaka, Hakaru TamukohIEEE Access · Kyushu Institute of Technology
    PDF ↗
  4. 2023
    Multilingual Continual Learning Approaches for Text ClassificationReveal, Chicago, IL, USA, Karan Praharaj, Irina Matveeva, Reveal, Chicago, IL, USAConference Recent Advances in Natural Language Processing…
    PDF ↗
  5. 2023
    Soft Alignment Objectives for Robust Adaptation of Language GenerationMichal Štefánik, Marek Kadlčík, Petr SojkaACL · Masaryk University
    PDF ↗
  6. 2023
    Visually Grounded Continual Language Learning with Selective SpecializationKyra Ahrens, Lennart Bengtson, Jae Yeol Lee, Stefan WermterEMNLP · Universität Hamburg
    PDF ↗
  7. 2023
    CLiCK: Continual Learning Exploiting Intermediate Network Models With A Slack ClassHyejin Kim, Seunghyun Yoon, Hyuk LimIEEE Access · Gwangju Institute of Science and Technology
    PDF ↗
  8. 2023
    Generalising via Meta-Examples for Continual Learning in the WildAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniSpringer LNCS · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  9. 2023
    Incorporating Syntactic Knowledge into Pre-trained Language Model using Optimization for Overcoming Catastrophic ForgettingRan Iwamoto, Issei Yoshida, Hiroshi Kanayama … Masayasu MuraokaEMNLP · Keio University · IBM Research - Tokyo
    PDF ↗
  10. 2020
    Overcoming Catastrophic Forgetting via Direction-Constrained OptimizationYunfei Teng, Anna Choromanska, Murray Campbell … Lior HoreshSpringer LNCS · New York University
    PDF ↗
  11. 2023
    FETCH: A Memory-Efficient Replay Approach for Continual Learning in Image ClassificationMarkus Weißflog, Peter Protzel, Peer NeubertSpringer LNCS · Chemnitz University of Technology · Koblenz University of Applied Sciences · +1
    PDF ↗
  12. 2023
    Filter Bank Networks for Few-Shot Class-Incremental LearningYanzhao Zhou, Binghao Liu, Yiran Liu, Jianbin JiaoComputer Modeling in Engineering & Sciences · University of Chinese Academy of Sciences
    PDF ↗
  13. 2023
    Human Inspired Progressive Alignment and Comparative Learning for Grounded Word AcquisitionYuwei Bao, Barrett Lattimer, Joyce ChaiACL · University of Michigan
    PDF ↗
  14. 2023
    Machine Learning and Knowledge Discovery in Databases: Research Track: European Conference, ECML PKDD 2023, Turin, Italy, September 18–22, 2023, Proceedings, Part VDanai Koutra, Claudia Plant, Manuel Gomez-Rodriguez … Francesco BonchiSpringer LNCS · University of Michigan · University of Vienna · +2
    PDF ↗
  15. 2023
    Prototypical quadruplet for few-shot class incremental learningSanchar Palit, Biplab Banerjee, Subhasis ChaudhuriProcedia Computer Science · Indian Institute of Technology Bombay
    PDF ↗
  16. 2023
    Incrementally Learned Angular Representations for Few-Shot Class-Incremental LearningIn-Ug Yoon, Jong-Hwan KimIEEE Access · Korea Advanced Institute of Science and Technology
    PDF ↗
  17. 2023
    Towards Continual Reinforcement Learning for Quadruped RobotsGiovanni Minelli, Vassilis VassiliadesIMET
    PDF ↗
  18. 2023PDF ↗
  19. 2023
    Deep Class-Incremental Learning: A SurveyDa-Wei Zhou, Qiwen Wang, Zhi-Hong Qi … Ziwei LiuarXiv
    PDF ↗
  20. 2023
    Real-Time Evaluation in Online Continual Learning: A New ParadigmYasir Ghunaim, Adel Bibi, K. Alhamoud … Bernard GhanemarXiv
    PDF ↗
  21. 2023
    Addressing Catastrophic Forgetting in Federated Class-Continual LearningJie Zhang, Chen Chen, Weiming Zhuang, Ling-Juan LvarXiv
    PDF ↗
  22. 2023PDF ↗
  23. 2023
    Continual Learning of Language ModelsZixuan Ke, Yijia Shao, Haowei Lin … Bin LiuICLR
    PDF ↗
  24. 2023
    Learning Representations on the Unit Sphere: Application to Online Continual LearningNicolas Michel, Giovanni Chierchia, R. Negrel, Jean-François BercherarXiv
    PDF ↗
  25. 2023PDF ↗
  26. 2023
    Active Continual Learning: Labelling Queries in a Sequence of TasksThuy-Trang Vu, Shahram Khadivi, Dinh Q. Phung, Gholamreza HaffariarXiv
    PDF ↗
  27. 2023
    Continually learning new languagesNgoc-Quan Pham, J. Niehues, A. WaibelarXiv
    PDF ↗
  28. 2023PDF ↗
  29. 2023PDF ↗
  30. 2023PDF ↗
  31. 2023PDF ↗
  32. 2023
    Primal-Dual Continual Learning: Stability and Plasticity through Lagrange MultipliersJuan Elenter, Navid Naderializadeh, Tara Javidi, Alejandro RibeiroarXiv
    PDF ↗
  33. 2023
    E2Net: Resource-Efficient Continual Learning with Elastic Expansion NetworkRuiqi Liu, Boyu Diao, Libo Huang … Yong-Jun XuarXiv
    PDF ↗
  34. 2023
    Few-Shot Continual Learning for Conditional Generative Adversarial NetworksCat P. Le, Juncheng Dong, Ahmed Aloui, Vahid TarokharXiv
    PDF ↗
  35. 2023PDF ↗
  36. 2022
    Self-Activating Neural Ensembles for Continual Reinforcement LearningSam Powers, Xing, Eliot, Gupta, AbhinavCoLLAs · Carnegie Mellon University · Meta (Israel)
    PDF ↗
  37. 2023PDF ↗
  38. 2023
    Sparse Coding in a Dual Memory System for Lifelong LearningFahad Sarfraz, Elahe Arani, Bahram ZonoozAAAI
    PDF ↗
  39. 2022
    Complementary Calibration: Boosting General Continual Learning With Collaborative Distillation and Self-SupervisionZhong Ji, Jin Li, Qiang Wang, Zhongfei ZhangTIP · Tianjin University · Binghamton University
    PDF ↗
  40. 2022
    Hierarchically structured task-agnostic continual learningHeinke Hihn, Daniel BraunMachine Learning · Universität Ulm
    PDF ↗
  41. 2022
    Saliency-Augmented Memory Completion for Continual LearningGuangji Bai, Ling Chen, Yuyang Gao, Liang ZhaoSDM
    PDF ↗
  42. 2022
    Towards Continual Reinforcement Learning: A Review and PerspectivesKhimya Khetarpal, Matthew Riemer, Irina Rish, Doina PrecupJournal of Artificial Intelligence Research · Google DeepMind (United Kingdom) · McGill University · +2
    PDF ↗
  43. 2023
    Lifelong Reinforcement Learning with Modulating MasksEseoghene Ben-Iwhiwhu, Saptarshi Nath, Praveen K. Pilly … Andrea SoltoggioTMLR
    PDF ↗
  44. 2023
    DSI++: Updating Transformer Memory with New DocumentsSanket Vaibhav Mehta, Jai Prakash Gupta, Yi Tay … Donald MetzlerEMNLP
    PDF ↗
  45. 2023PDF ↗
  46. 2023
    Multi-Label Classification via Adaptive Resonance Theory-Based ClusteringNaoki Masuyama, Yusuke Nojima, Chu Kiong Loo, Hisao IshibuchiTPAMI · Osaka Metropolitan University · University of Malaya · +1
    PDF ↗
  47. 2023PDF ↗
  48. 2022
    Sleep-like unsupervised replay reduces catastrophic forgetting in artificial neural networksTimothy Tadros, Giri P. Krishnan, Ramyaa Ramyaa, Maxim BazhenovNature Communications · University of California San Diego · New Mexico Institute of Mining and Technology
    PDF ↗
  49. 2022
    DIODE: Dilatable Incremental Object DetectionCan Peng, Kun Zhao, Sam Maksoud … Brian C. LovellPattern Recognition · The University of Queensland
    PDF ↗
  50. 2022PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.