Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 3901–3950Sort Recent · Most cited
  1. 2021
    Dynamic VAEs with Generative Replay for Continual Zero-shot LearningSubhankar GhosharXiv · Indian Institute of Science Bangalore
    PDF ↗
  2. 2022
    How Well Does Self-Supervised Pre-Training Perform with Streaming Data?Dapeng Hu, Shipeng Yan, Qizhengqiu Lu … Jiashi FengICLR
    PDF ↗
  3. 2021
    Learning in Deep Neural Networks Using a Biologically Inspired OptimizerGiorgia Dellaferrera, Stanisław Woźniak, Giacomo Indiveri … Evangelos EleftheriouarXiv
    PDF ↗
  4. 2021
    3D_DEN: Open-Ended 3-D Object Recognition Using Dynamically Expandable NetworksSudhakaran Jain, Hamidreza KasaeiIEEE TCDS · University of Groningen
    PDF ↗
  5. 2021
    Sequential Targeting: an incremental learning approach for data imbalance in text classificationJoel Jang, Yoonjeon Kim, Kyoung-Ho Choi, Sungho SuhExpert Systems with Applications · Korea Advanced Institute of Science and Technology · Naver (South Korea) · +1
    PDF ↗
  6. 2021
    Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNsYuwei Cao, Hao Peng, Jia Wu … Philip S. YuWWW · University of Illinois Chicago · Beihang University · +1
    PDF ↗
  7. 2021
    Continual Learning with Fully Probabilistic ModelsBenedikt Pfülb, Alexander Gepperth, Benedikt BagusarXiv · Fulda University of Applied Sciences
    PDF ↗
  8. 2021
    Few-shot Continual Learning: a Brain-inspired ApproachLiyuan Wang, Qian Li, Yi Zhong, Jun ZhuarXiv
    PDF ↗
  9. 2021
    Lifelong Learning with Sketched Structural RegularizationHaoran Li, Aditya Krishnan, Jingfeng Wu … Vladimir BravermanMachine Learning
    PDF ↗
  10. 2022
    New Insights on Reducing Abrupt Representation Change in Online Continual LearningLucas Caccia, Rahaf Aljundi, Nader Asadi … Eugene BelilovskyICLR
    PDF ↗
  11. 2021
    Unsupervised Class-Incremental Learning Through ConfusionShivam Khare, Kun Cao, James M. RehgarXiv · Georgia Institute of Technology
    PDF ↗
  12. 2021PDF ↗
  13. 2021PDF ↗
  14. 2021
    Half-Real Half-Fake Distillation for Class-Incremental Semantic SegmentationZilong Huang, Wentian Hao, Xinggang Wang … Xian‐Sheng HuaarXiv
    PDF ↗
  15. 2021
    Concept Drift Detection from Multi-Class Imbalanced Data StreamsŁukasz Korycki, Bartosz KrawczykICDE · Virginia Commonwealth University
    PDF ↗
  16. 2021
    Multi-task continuous learning modelZhengbing Guo, Meng WangJournal of Physics Conference Series · Kunming University of Science and Technology
    PDF ↗
  17. 2021PDF ↗
  18. 2021PDF ↗
  19. 2021
    Continual Speaker Adaptation for Text-to-Speech SynthesisHamed Hemati, Damian BortharXiv · University of St.Gallen
    PDF ↗
  20. 2021PDF ↗
  21. 2021PDF ↗
  22. 2021
    Gradient Projection Memory for Continual LearningGobinda Saha, Garg, Isha, Roy, KaushikICLR · Purdue University West Lafayette
    PDF ↗
  23. 2021
    Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit RecognitionÖzgür Kara, Nikhil Churamani, Hatice GüneşarXiv · Boğaziçi University · University of Cambridge
    PDF ↗
  24. 2021
    Learning Novel Objects Continually Through CuriosityAli Ayub, Alan R. WagnerarXiv · Pennsylvania State University
    PDF ↗
  25. 2021
    Continual Density Ratio Estimation in an Online SettingYu Chen, Song Liu, Tom Diethe, Peter FlacharXiv
    PDF ↗
  26. 2021
    Continual Learning of Visual Concepts for Robots through Limited SupervisionAli Ayub, Alan R. WagnerIEEE/ACM International Conference on Human-Robot Interaction · Pennsylvania State University
    PDF ↗
  27. 2021
    CAM-GAN: Continual Adaptation Modules for Generative Adversarial NetworksSakshi Varshney, Vinay Kumar Verma, P K Srijith … Piyush RaiNeurIPS
    PDF ↗
  28. 2021
    Learning to Continually Learn Rapidly from Few and Noisy DataNicholas I-Hsien Kuo, Mehrtash Harandi, Nicolas Fourrier … Hanna SuominenAAAI · Australian National University
    PDF ↗
  29. 2021
    Continuous Coordination As a Realistic Scenario for Lifelong LearningHadi Nekoei, Akilesh Badrinaaraayanan, Aaron Courville, Sarath ChandarICML · Centre Universitaire de Mila · Université de Montréal · +1
    PDF ↗
  30. 2021PDF ↗
  31. 2021
    Meta-Learned Attribute Self-Gating for Continual Generalized Zero-Shot LearningVinay Kumar Verma, Kevin J Liang, Nikhil Mehta, Lawrence CarinarXiv · Duke University
    PDF ↗
  32. 2021PDF ↗
  33. 2022
    Beneficial Perturbation Network for Designing General Adaptive Artificial Intelligence SystemsShixian Wen, Amanda Rios, Yunhao Ge, Laurent IttiTNNLS · University of Southern California
    PDF ↗
  34. 2021
    Continual Learning from Synthetic Data for a Humanoid Exercise RobotNicolas Duczek, Matthias Kerzel, Stefan WermterarXiv
    PDF ↗
  35. 2020
    Firefly Neural Architecture Descent: a General Approach for Growing Neural NetworksLemeng Wu, Bo Liu, Peter Stone, Qiang LiuNeurIPS · The University of Texas at Austin
    PDF ↗
  36. 2021
    A comparative study of calibration methods for imbalanced class incremental learningUmang Aggarwal, Adrian Popescu, Eden Belouadah, Céline HudelotMultimedia Tools and Applications · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · +5
    PDF ↗
  37. 2021
    GP-Tree: A Gaussian Process Classifier for Few-Shot Incremental LearningIdan Achituve, Aviv Navon, Yochai Yemini … Ethan FetayaICML · Bar-Ilan University
    PDF ↗
  38. 2021
    Self-Supervised Features Improve Open-World LearningAkshay Raj Dhamija, Touqeer Ahmad, Jonathan Schwan … Terrance E. BoultarXiv · University of Colorado Colorado Springs
    PDF ↗
  39. 2021
    Does the Adam Optimizer Exacerbate Catastrophic Forgetting?Dylan R. Ashley, Sina Ghiassian, Richard S. SuttonarXiv
    PDF ↗
  40. 2022
    Lifelong Incremental Reinforcement Learning With Online Bayesian InferenceZhi Wang, Chunlin Chen, Daoyi DongTNNLS · Nanjing University · University of Canberra · +1
    PDF ↗
  41. 2019
    Overcoming Long-Term Catastrophic Forgetting Through Adversarial Neural Pruning and Synaptic ConsolidationJian Peng, Bo Tang, Hao Jiang … Haifeng LiTNNLS · Central South University · Mississippi State University · +3
    PDF ↗
  42. 2021
    Reproducibility Report: La-MAML: Look-ahead Meta Learning for Continual LearningJoel Joseph, Alex GuarXiv · Indian Institute of Technology BHU · Banaras Hindu University · +1
    PDF ↗
  43. 2021
    Continuum: Simple Management of Complex Continual Learning ScenariosArthur Douillard, Timothée LesortarXiv · Mila - Quebec Artificial Intelligence Institute
    PDF ↗
  44. 2021
    Online Limited Memory Neural-Linear Bandits with Likelihood MatchingOfir Nabati, Tom Zahavy, Shie MannorICML · Technion – Israel Institute of Technology · Google DeepMind (United Kingdom)
    PDF ↗
  45. 2022
    How do Quadratic Regularizers Prevent Catastrophic Forgetting: The Role of InterpolationEkdeep Singh Lubana, Puja Trivedi, Danai Koutra, Robert P. DickCoLLAs · University of Michigan
    PDF ↗
  46. 2021
    Continual Learning of Knowledge Graph EmbeddingsAngel Daruna, Mehul Gupta, Mohan Sridharan, Sonia ChernovaRA-L · Georgia Institute of Technology · University of Birmingham
    PDF ↗
  47. 2021
    Self-Attention Meta-Learner for Continual LearningGhada Sokar, D. Mocanu, Mykola PechenizkiyAdaptive Agents and Multi-Agent Systems
    PDF ↗
  48. 2021
    Prediction Error-Driven Memory Consolidation for Continual Learning: On the Case of Adaptive Greenhouse ModelsGuido Schillaci, Uwe Schmidt, Luis MirandaKünstliche Intell. · Scuola Superiore Sant'Anna · Humboldt-Universität zu Berlin · +1
    PDF ↗
  49. 2021
    SpaceNet: Make Free Space For Continual LearningGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiyNeurocomputing · Eindhoven University of Technology · University of Twente
    PDF ↗
  50. 2021
    Knowledge Distillation for Incremental Learning in Semantic SegmentationUmberto Michieli, Pietro ZanuttighComputer Vision and Image Understanding · University of Padua
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.