Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

71 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2022PDF ↗
  2. 2022
    Open World DETR: Transformer based Open World Object DetectionNa Dong, Yongqiang Zhang, Mingli Ding, Gim Hee LeearXiv
    PDF ↗
  3. 2022PDF ↗
  4. 2022
    Progressive Learning without ForgettingTao Feng, Hangjie Yuan, Mang Wang … Jianzhou ZhangarXiv
    PDF ↗
  5. 2022
    Neural Architecture for Online Ensemble Continual LearningMateusz Wójcik, Witold Kościukiewicz, Tomasz Kajdanowicz, Adam GonczarekarXiv
    PDF ↗
  6. 2022PDF ↗
  7. 2022
    Integral Continual Learning Along the Tangent Vector Field of TasksTian Yu Liu, Aditya Golatkar, Stefano Soatto, Alessandro AchillearXiv
    PDF ↗
  8. 2022
    Delving into Transformer for Incremental Semantic SegmentationZekai Xu, Mingyi Zhang, Jiayue Hou … Junge ZhangarXiv
    PDF ↗
  9. 2022PDF ↗
  10. 2022PDF ↗
  11. 2022
    Cold Start Streaming Learning for Deep NetworksC. Wolfe, Anastasios KyrillidisarXiv
    PDF ↗
  12. 2022PDF ↗
  13. 2022
    Overcoming Barriers to Skill Injection in Language Modeling: Case Study in ArithmeticMandar Sharma, Nikhil Muralidhar, Naren RamakrishnanarXiv
    PDF ↗
  14. 2022PDF ↗
  15. 2022
    RAIS: Robust and Accurate Interactive Segmentation via Continual LearningYuying Hao, Yi Liu, Juncai Peng … Baohua LaiarXiv
    PDF ↗
  16. 2022PDF ↗
  17. 2022
    Schedule-Robust Online Continual LearningRuohan Wang, Marco Ciccone, Giulia Luise … Carlo CilibertoarXiv
    PDF ↗
  18. 2022PDF ↗
  19. 2022
    A Simple Baseline that Questions the Use of Pretrained-Models in Continual LearningPaul Janson, Wenxuan Zhang, Rahaf Aljundi, Mohamed ElhoseinyarXiv
    PDF ↗
  20. 2022
    CLIP model is an Efficient Continual LearnerVishal Thengane, Salman Khan, Munawar Hayat, Fahad Shahbaz KhanarXiv
    PDF ↗
  21. 2022
    ImpressLearn: Continual Learning via Combined Task ImpressionsDhrupad Bhardwaj, Julia Kempe, Artem Vysogorets … Evaristus C. EzekwemarXiv
    PDF ↗
  22. 2022
    HyperHawkes: Hypernetwork based Neural Temporal Point ProcessManisha Dubey, P. K. Srijith, Maunendra Sankar DesarkararXiv
    PDF ↗
  23. 2022
    Task Formulation Matters When Learning Continually: A Case Study in Visual Question AnsweringMavina Nikandrou, Yu Lu, Alessandro Suglia … Verena RieserarXiv
    PDF ↗
  24. 2022
    Multiple Modes for Continual LearningSiddhartha Datta, Nigel ShadboltarXiv
    PDF ↗
  25. 2022PDF ↗
  26. 2022PDF ↗
  27. 2022PDF ↗
  28. 2022PDF ↗
  29. 2022
    Continual Reinforcement Learning with TELLANeil Fendley, Cash Costello, Éric Nguyen … Corey LowmanarXiv
    PDF ↗
  30. 2022PDF ↗
  31. 2022PDF ↗
  32. 2022PDF ↗
  33. 2022
    Latent Properties of Lifelong Learning SystemsCorban G. Rivera, Chace Ashcraft, Alexander New … Gautam K. VallabhaarXiv
    PDF ↗
  34. 2022PDF ↗
  35. 2022
    Don't Stop Learning: Towards Continual Learning for the CLIP ModelYuxuan Ding, Lingqiao Liu, Chunna Tian … Haoxuan DingarXiv
    PDF ↗
  36. 2022PDF ↗
  37. 2022
    Class-Incremental Lifelong Learning in Multi-Label ClassificationKaile Du, Linyan Li, Fan Lyu … Fenglei XuarXiv
    PDF ↗
  38. 2022
    E2-AEN: End-to-End Incremental Learning with Adaptively Expandable NetworkGuimei Cao, Zhanzhan Cheng, Yunlu Xu … Fei WuarXiv
    PDF ↗
  39. 2022
    An Introduction to Lifelong Supervised LearningShagun Sodhani, Mojtaba Faramarzi, Sanket Vaibhav Mehta … Sarath ChandararXiv
    PDF ↗
  40. 2022
    Continual Few-Shot Learning with Adversarial Class StorageKun Wu, Chengxiang Yin, Jian Tang … Dejun YangarXiv
    PDF ↗
  41. 2022PDF ↗
  42. 2022PDF ↗
  43. 2022PDF ↗
  44. 2022
    Debugging using Orthogonal Gradient DescentNarsimha Chilkuri, Chris EliasmitharXiv
    PDF ↗
  45. 2022PDF ↗
  46. 2022PDF ↗
  47. 2022PDF ↗
  48. 2022
    The Effect of Task Ordering in Continual LearningSamuel J. Bell, Neil D. LawrencearXiv
    PDF ↗
  49. 2022PDF ↗
  50. 2022PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.