Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

153 papers of 11,817 · showing 1–50Sort Recent · Most cited
  1. 2022
    Efficient Induction of Language Models Via Probabilistic Concept FormationChristopher J. MacLellan, Peter Matsakis, Pat LangleyarXiv
    PDF ↗
  2. 2022PDF ↗
  3. 2022
    Open World DETR: Transformer based Open World Object DetectionNa Dong, Yongqiang Zhang, Mingli Ding, Gim Hee LeearXiv
    PDF ↗
  4. 2022PDF ↗
  5. 2022PDF ↗
  6. 2022
    Single image calibration using knowledge distillation approachesKhadidja Ould Amer, Oussama Hadjerci, Mohamed Abbas Hedjazi, Antoine LetiennearXiv
    PDF ↗
  7. 2022
    Task-Specific Embeddings for Ante-Hoc Explainable Text ClassificationKishaloy Halder, Josip Krapac, Alan Akbik … Matti LyraarXiv
    PDF ↗
  8. 2022
    Progressive Learning without ForgettingTao Feng, Hangjie Yuan, Mang Wang … Jianzhou ZhangarXiv
    PDF ↗
  9. 2022
    Neural Architecture for Online Ensemble Continual LearningMateusz Wójcik, Witold Kościukiewicz, Tomasz Kajdanowicz, Adam GonczarekarXiv
    PDF ↗
  10. 2022PDF ↗
  11. 2022PDF ↗
  12. 2022
    Integral Continual Learning Along the Tangent Vector Field of TasksTian Yu Liu, Aditya Golatkar, Stefano Soatto, Alessandro AchillearXiv
    PDF ↗
  13. 2022
    Delving into Transformer for Incremental Semantic SegmentationZekai Xu, Mingyi Zhang, Jiayue Hou … Junge ZhangarXiv
    PDF ↗
  14. 2022
    NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision ResearchJörg Bornschein, Alexandre Galashov, Ross Hemsley … Marc’Aurelio RanzatoarXiv
    PDF ↗
  15. 2022PDF ↗
  16. 2022PDF ↗
  17. 2022
    Cold Start Streaming Learning for Deep NetworksC. Wolfe, Anastasios KyrillidisarXiv
    PDF ↗
  18. 2022
    Continual learning autoencoder training for a particle-in-cell simulation via streamingPatrick Stiller, Varun Makdani, Franz Pöschel … Nico HoffmannarXiv
    PDF ↗
  19. 2022PDF ↗
  20. 2022
    Overcoming Barriers to Skill Injection in Language Modeling: Case Study in ArithmeticMandar Sharma, Nikhil Muralidhar, Naren RamakrishnanarXiv
    PDF ↗
  21. 2022PDF ↗
  22. 2022PDF ↗
  23. 2022
    An Exploration of Data Efficiency in Intra-Dataset Task Transfer for Dialog UnderstandingJosiah Ross, Luke Yoffe, Alon Albalak, William Yang WangarXiv
    PDF ↗
  24. 2022PDF ↗
  25. 2022
    Watermarking Pre-trained Language Models with BackdooringC. Gu, Chengsong Huang, Xiaoqing Zheng … Cho‐Jui HsieharXiv
    PDF ↗
  26. 2022PDF ↗
  27. 2022
    Schedule-Robust Online Continual LearningRuohan Wang, Marco Ciccone, Giulia Luise … Carlo CilibertoarXiv
    PDF ↗
  28. 2022PDF ↗
  29. 2022
    A Simple Baseline that Questions the Use of Pretrained-Models in Continual LearningPaul Janson, Wenxuan Zhang, Rahaf Aljundi, Mohamed ElhoseinyarXiv
    PDF ↗
  30. 2022
    CLIP model is an Efficient Continual LearnerVishal Thengane, Salman Khan, Munawar Hayat, Fahad Shahbaz KhanarXiv
    PDF ↗
  31. 2022
    Topological Continual Learning with Wasserstein Distance and BarycenterTananun Songdechakraiwut, Xiaoshuang Yin, B.D. Van VeenarXiv
    PDF ↗
  32. 2022
    ImpressLearn: Continual Learning via Combined Task ImpressionsDhrupad Bhardwaj, Julia Kempe, Artem Vysogorets … Evaristus C. EzekwemarXiv
    PDF ↗
  33. 2022
    Task Formulation Matters When Learning Continually: A Case Study in Visual Question AnsweringMavina Nikandrou, Yu Lu, Alessandro Suglia … Verena RieserarXiv
    PDF ↗
  34. 2022
    Multiple Modes for Continual LearningSiddhartha Datta, Nigel ShadboltarXiv
    PDF ↗
  35. 2022PDF ↗
  36. 2022
    Continual VQA for Disaster Response SystemsAditya Kane, V Manushree, Sahil KhosearXiv
    PDF ↗
  37. 2022
    Extreme Multi-Domain, Multi-Task Learning With Unified Text-to-Text Transfer TransformersAdebayo Oshingbesan, Courage Ekoh, Germann Atakpa, Yonah ByaruagabaarXiv
    PDF ↗
  38. 2022PDF ↗
  39. 2022PDF ↗
  40. 2022
    Continual learning benefits from multiple sleep mechanisms: NREM, REM, and Synaptic DownscalingBrian Robinson, Clare W. Lau, Alexander New … William G. CoonarXiv
    PDF ↗
  41. 2022PDF ↗
  42. 2022PDF ↗
  43. 2022
    Continual Learning for SteganalysisZihao Yin, Ruohan Meng, Zhili ZhouarXiv
    PDF ↗
  44. 2022PDF ↗
  45. 2022PDF ↗
  46. 2022
    Beyond Supervised Continual Learning: a ReviewBenedikt Bagus, Alexander Gepperth, Timothée LesortarXiv
    PDF ↗
  47. 2022PDF ↗
  48. 2022
    Empirical investigations on WVA structural issuesAlexey Kutalev, Alisa LapinaarXiv
    PDF ↗
  49. 2022
    ATLAS: Universal Function Approximator for Memory RetentionHeinrich van Deventer, Anna Sergeevna BosmanarXiv
    PDF ↗
  50. 2022
    Continual Reinforcement Learning with TELLANeil Fendley, Cash Costello, Éric Nguyen … Corey LowmanarXiv
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.