Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 4001–4050Sort Recent · Most cited
  1. 2021
    Explaining How Deep Neural Networks Forget by Deep VisualizationGiang V. Nguyen, Chen Shuan, Tae Joon Jun, Daeyoung KimSpringer LNCS · Korea Advanced Institute of Science and Technology · Ansan University
    PDF ↗
  2. 2021
    Sustainable Artificial Intelligence through Continual LearningAndrea Cossu, Marta Ziosi, Vincenzo LomonacoInternational Conference on AI for People: Towards Sustai… · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  3. 2021
    DRILL: Dynamic Representations for Imbalanced Lifelong LearningKyra Ahrens, Fares Abawi, Stefan WermterSpringer LNCS · Universität Hamburg
    PDF ↗
  4. 2021PDF ↗
  5. 2021
    Lifelong Knowledge-Enriched Social Event Representation LearningPrashanth Vijayaraghavan, Deb RoyEACL · IIT@MIT · Human Media
    PDF ↗
  6. 2021
    Class-incremental Learning with Rectified Feature-Graph PreservationCheng-Hsun Lei, Yi-Hsin Chen, Wen-Hsiao Peng, Wei-Chen ChiuSpringer LNCS · National Yang Ming Chiao Tung University
    PDF ↗
  7. 2021
    HCV: Hierarchy-Consistency Verification for Incremental Implicitly-Refined ClassificationKai Wang, Xialei Liu, Luis Herranz, Joost van de WeijerBMVC · Universitat Autònoma de Barcelona · Nankai University
    PDF ↗
  8. 2021
    Hyperparameter-free Continuous Learning for Domain Classification in Natural Language UnderstandingTing Hua, Yilin Shen, Changsheng Zhao … Hongxia JinNAACL · Samsung (United States) · Research!America (United States)
    PDF ↗
  9. 2021
    On robustness of generative representations against catastrophic forgettingWojciech Masarczyk, Kamil Rafał Deja, T. P. TrzcinskiSpringer CCIS · Warsaw University of Technology · Jagiellonian University
    PDF ↗
  10. 2021
    Homeostasis-Inspired Continual Learning: Learning to Control Structural RegularizationJoonyoung Kim, Hyowoon Seo, Wan Choi, Kyomin JungIEEE Access · Seoul National University · University of Oulu · +1
    PDF ↗
  11. 2021
    Incremental Learning for Animal Pose Estimation using RBF k-DPPGaurav Kumar Nayak, Het Shah, Anirban ChakrabortyBMVC · Indian Institute of Science Bangalore
    PDF ↗
  12. 2021
    Principal Gradient Direction and Confidence Reservoir Sampling for Continual LearningZhiyi Chen, Tong LinSpringer LNCS · Georgia Institute of Technology · Peking University · +1
    PDF ↗
  13. 2021
    Lifelong Learning from Event-based DataVadym Gryshchuk, Cornelius Weber, Chu Kiong Loo, Stefan WermterESANN 2021 proceedings · Universität Hamburg · University of Malaya
    PDF ↗
  14. 2021
    Lifelong Explainer for Lifelong LearnersXuelin Situ, Sameen Maruf, Ingrid Zukerman … Gholamreza HaffariEMNLP · Monash University · Commonwealth Scientific and Industrial Research Organisation · +2
    PDF ↗
  15. 2021PDF ↗
  16. 2021
    Efficient Continual Learning with Modular Networks and Task-Driven PriorsTom Véniat, Ludovic Denoyer, Marc’Aurelio RanzatoICLR · Meta (United States)
    PDF ↗
  17. 2020
    Detecting Changes and Avoiding Catastrophic Forgetting in Dynamic Partially Observable EnvironmentsJeffery Dick, Paweł Ładosz, Eseoghene Ben-Iwhiwhu … Andrea SoltoggioFrontiers · Loughborough University · Teikyo University · +1
    PDF ↗
  18. 2020
    Selective Forgetting of Deep Networks at a Finer Level than SamplesTomohiro Hayase, Suguru Yasutomi, Takashi KatoharXiv
    PDF ↗
  19. 2019
    Representative Task Self-Selection for Flexible Clustered Lifelong LearningGan Sun, Yang Cong, Qianqian Wang … Yun FuTNNLS · Northeastern University · Shenyang Institute of Automation · +3
    PDF ↗
  20. 2020
    Consequences of Slow Neural Dynamics for Incremental LearningShima Rahimi Moghaddam, Fanjun Bu, Christopher J. HoneyarXiv
    PDF ↗
  21. 2021
    River: machine learning for streaming data in PythonJacob Montiel, Max Halford, Saulo Martiello Mastelini … Albert BifetJMLR · University of Waikato · Universidade de São Paulo · +14
    PDF ↗
  22. 2021
    A Comprehensive Study of Class Incremental Learning Algorithms for Visual TasksEden Belouadah, Adrian Popescu, Ioannis KanellosNeural Networks · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · +2
    PDF ↗
  23. 2021
    Reset-Free Lifelong Learning with Skill-Space PlanningKevin Lü, Aditya Grover, Pieter Abbeel, Igor MordatchICLR · University of California, Berkeley · Stanford University · +1
    PDF ↗
  24. 2020
    Pseudo-Rehearsal: Achieving Deep Reinforcement Learning without Catastrophic ForgettingCraig Atkinson, Brendan McCane, Lech Szymanski, Anthony RobinsNeurocomputing · University of Otago
    PDF ↗
  25. 2020
    Association: Remind Your GAN not to ForgetYi Gu, Jie Li, Yuting Gao … Zhang, ZiruiarXiv
    PDF ↗
  26. 2019
    Better Knowledge Retention through Metric LearningKe Li, Shichong Peng, Kailas Vodrahalli, Jitendra MalikarXiv
    PDF ↗
  27. 2021
    Generalized Variational Continual LearningNoel Loo, Siddharth Swaroop, Richard E. TurnerICLR · University of Cambridge
    PDF ↗
  28. 2022
    Energy-Based Models for Continual LearningShuang Li, Yilun Du, Gido M. van de Ven, Igor MordatchCoLLAs · Massachusetts Institute of Technology
    PDF ↗
  29. 2020
    Consolidation via Policy Information Regularization in Deep RL for Multi-Agent GamesTyler Malloy, Tim Klinger, Miao Liu … Chris R. SimsarXiv
    PDF ↗
  30. 2020
    Generalized Continual Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramarXiv · Indian Institute of Science Bangalore · Indian Institute of Technology Madras
    PDF ↗
  31. 2020PDF ↗
  32. 2020
    Continual Learning with Deep Artificial NeuronsBlake Camp, Jaya Krishna Mandivarapu, Rolando EstradaarXiv · Georgia State University
    PDF ↗
  33. 2020
    Incremental Learning Using a Grow-and-Prune Paradigm With Efficient Neural NetworksXiaoliang Dai, Hongxu Yin, Niraj K. JhaIEEE Transactions · Princeton University
    PDF ↗
  34. 2020
    Lifelong learning of interpretable image representationsFei Ye, Adrian G. BorşICIP · University of York
    PDF ↗
  35. 2020
    Meta-Learning for Natural Language Understanding under Continual Learning FrameworkJiacheng Wang, Yong Fan, Duo Jiang, Shiqing LiarXiv · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +1
    PDF ↗
  36. 2020
    Learn-Prune-Share for Lifelong LearningZifeng Wang, Tong Jian, Kaushik Chowdhury … Stratis IoannidisICDM · Northeastern University
    PDF ↗
  37. 2020
    CLIFER: Continual Learning with Imagination for Facial Expression RecognitionNikhil Churamani, Hatice GüneşIEEE International Conference on Automatic Face and Gestu… · University of Cambridge
    PDF ↗
  38. 2020
    Lifelong Learning Without a Task OracleAmanda Rios, Laurent IttiIEEE 32nd International Conference on Tools with Artifici… · University of Southern California
    PDF ↗
  39. 2020
    A Study on Efficiency in Continual Learning Inspired by Human LearningPhilip Ball, Yingzhen Li, Angus Lamb, Cheng ZhangarXiv
    PDF ↗
  40. 2020
    SERIL: Noise Adaptive Speech Enhancement using Regularization-based Incremental LearningChi-Chang Lee, Yu-Chen Lin, Hsuan-Tien Lin … Yu TsaoInterspeech
    PDF ↗
  41. 2020
    Latent Replay for Real-Time Continual LearningLorenzo Pellegrini, Gabriele Graffieti, Vincenzo Lomonaco, Davide MaltoniIROS · University of Bologna
    PDF ↗
  42. 2020
    Tell me what this is: Few-Shot Incremental Object Learning by a RobotAli Ayub, Alan R. WagnerIROS · Pennsylvania State University
    PDF ↗
  43. 2020
    A Combinatorial Perspective on Transfer LearningJianan Wang, Eren Sezener, David Budden … Joel VenessNeurIPS · Google (United States)
    PDF ↗
  44. 2020
    Continual Learning in Low-rank Orthogonal SubspacesArslan Chaudhry, Naeemullah Khan, Puneet K. Dokania, Philip H. S. TorrNeurIPS · University of Oxford
    PDF ↗
  45. 2020
    Streaming Graph Neural Networks via Continual LearningJunshan Wang, Guojie Song, Yi Wu, Liang WangCIKM · Peking University · Alibaba Group (China)
    PDF ↗
  46. 2020
    GraphSAIL: Graph Structure Aware Incremental Learning for Recommender SystemsYishi Xu, Yingxue Zhang, Wei Guo … Mark CoatesCIKM · Université de Montréal · Huawei Technologies (Canada) · +2
    PDF ↗
  47. 2020
    Continual Domain Adaptation for Machine Reading ComprehensionLixin Su, Jiafeng Guo, Ruqing Zhang … Xueqi ChengCIKM · Computer Network Information Center · University of Chinese Academy of Sciences
    PDF ↗
  48. 2020
    Continual Unsupervised Domain Adaptation for Semantic SegmentationJoonhyuk Kim, Sahng-Min Yoo, Gyeong-Moon Park, Jong-Hwan KimarXiv
    PDF ↗
  49. 2020
    Continual Learning for Neural Semantic ParsingVladislav Lialin, Rahul Goel, Andrey Simanovsky … Rushin ShaharXiv · University of Massachusetts Lowell · Google (United States)
    PDF ↗
  50. 2021
    Linear Mode Connectivity in Multitask and Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Görür … Hassan GhasemzadehICLR · Washington State University · Google (United States)
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.