Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

40 papers of 11,817Sort Recent · Most cited
  1. 2022
    Continual Learning with Global AlignmentXueying Bai, Jinghuan Shang, Yifan Sun, Niranjan BalasubramanianNeurIPS
    PDF ↗
  2. 2022PDF ↗
  3. 2022
    Wild-Time: A Benchmark of in-the-Wild Distribution Shift over TimeHuaxiu Yao, Caroline Choi, Bochuan Cao … Chelsea FinnNeurIPS
    PDF ↗
  4. 2022
    Mining Unseen Classes via Regional Objectness: A Simple Baseline for Incremental SegmentationZekang Zhang, Guangyu Gao, Zhiyuan Fang … Yunchao WeiNeurIPS
    PDF ↗
  5. 2022
    A Theoretical Study on Solving Continual LearningGyuhak Kim, Changnan Xiao, Tatsuya Konishi … Bing LiuNeurIPS
    PDF ↗
  6. 2022
    Learning a Condensed Frame for Memory-Efficient Video Class-Incremental LearningYixuan Pei, Zhiwu Qing, Jun Cen … Xueming QianNeurIPS
    PDF ↗
  7. 2022
    Beyond Not-Forgetting: Continual Learning with Backward Knowledge TransferSen Lin, Li Yang, Deliang Fan, Junshan ZhangNeurIPS
    PDF ↗
  8. 2022
    Streaming Radiance Fields for 3D Video SynthesisLingzhi Li, Zhen Shen, Zhongshu Wang … Ping TanNeurIPS
    PDF ↗
  9. 2022PDF ↗
  10. 2022PDF ↗
  11. 2022
    On the Effectiveness of Lipschitz-Driven Rehearsal in Continual LearningLorenzo Bonicelli, M. Boschini, Angelo Porrello … Simone CalderaraNeurIPS
    PDF ↗
  12. 2022
    Decomposed Knowledge Distillation for Class-Incremental Semantic SegmentationDonghyeon Baek, Youngmin Oh, Sanghoon Lee … Bumsub HamNeurIPS
    PDF ↗
  13. 2022PDF ↗
  14. 2022PDF ↗
  15. 2022
    Few-Shot Continual Active Learning by a RobotAli Ayub, Carter FendleyNeurIPS
    PDF ↗
  16. 2022
    Disentangling Transfer in Continual Reinforcement LearningMaciej Wołczyk, Michał Zając, Razvan Pascanu … Piotr MiłośNeurIPS
    PDF ↗
  17. 2022
    Exploring Example Influence in Continual LearningQing Sun, Fan Lyu, Fanhua Shang … Liang WanNeurIPS
    PDF ↗
  18. 2022
    SparCL: Sparse Continual Learning on the EdgeZifeng Wang, Zheng Zhan, Yifan Gong … Jennifer DyNeurIPS
    PDF ↗
  19. 2022
    BOME! Bilevel Optimization Made Easy: A Simple First-Order ApproachMao Ye, Бо Лю, Stephen Wright … Qiang LiuNeurIPS
    PDF ↗
  20. 2022PDF ↗
  21. 2022
    Repairing Neural Networks by Leaving the Right Past BehindRyutaro Tanno, Melanie F. Pradier, Aditya Nori, Yingzhen LiNeurIPS
    PDF ↗
  22. 2022
    Lifelong Inverse Reinforcement LearningJorge A. Mendez, Shashank Shivkumar, Eric EatonNeurIPS · University of Pennsylvania · Philadelphia University
    PDF ↗
  23. 2022
    On-Device Training Under 256KB MemoryJi Lin, Ligeng Zhu, Wei-Ming Chen … Song HanNeurIPS
    PDF ↗
  24. 2022
    CLiMB: A Continual Learning Benchmark for Vision-and-Language TasksTejas Srinivasan, Ting-Yun Chang, Leticia Leonor Pinto Alva … Jesse ThomasonNeurIPS
    PDF ↗
  25. 2022PDF ↗
  26. 2022
    Dataset Distillation using Neural Feature RegressionYongchao Zhou, Ehsan Nezhadarya, Jimmy BaNeurIPS
    PDF ↗
  27. 2022PDF ↗
  28. 2022
    ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy ProtectionHuiping Zhuang, Zhenyu Weng, Wei, Hongxin … Zhiping LinNeurIPS
    PDF ↗
  29. 2022PDF ↗
  30. 2022
    The CLEAR Benchmark: Continual LEArning on Real-World ImageryZhiqiu Lin, Jia Shi, Deepak Pathak, Deva RamananNeurIPS
    PDF ↗
  31. 2022PDF ↗
  32. 2022
    CGLB: Benchmark Tasks for Continual Graph LearningXikun Zhang, Dongjin Song, Dacheng TaoNeurIPS
  33. 2022
    Memory Efficient Continual Learning with TransformersBeyza Ermis, Giovanni Zappella, Martin Wistuba … Cédric ArchambeauNeurIPS
    PDF ↗
  34. 2022
    Repeated Augmented Rehearsal: A Simple but Strong Baseline for Online Continual LearningYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
    PDF ↗
  35. 2022
    Retrospective Adversarial Replay for Continual LearningLilly Kumari, Shengjie Wang, Tianyi Zhou, Jeff BilmesNeurIPS
  36. 2022
    Continual Learning with Evolving Class OntologiesZhiqiu Lin, Deepak Pathak, Yu-Xiong Wang … Shu KongNeurIPS
    PDF ↗
  37. 2022
    How Well Do Unsupervised Learning Algorithms Model Human Real-time and Life-long Learning?Chengxu Zhuang, Ziyu Xiang, Yoon Bai … Daniel YaminsNeurIPS
  38. 2022
  39. 2022
    A simple but strong baseline for online continual learning: Repeated Augmented RehearsalYaqian Zhang, Bernhard Pfahringer, Eibe Frank … Yunzhe JiaNeurIPS
  40. 2022
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.