Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

301 papers of 8,653 · showing 51–100Sort Recent · Most cited
  1. 2020
    Continual Learning in Low-rank Orthogonal SubspacesArslan Chaudhry, Naeemullah Khan, Puneet K. Dokania, Philip H. S. TorrNeurIPS · University of Oxford
    PDF ↗
  2. 2020
    An integrated classification model for incremental learningJi Hu, Chenggang Yan, Xin Liu … Yi YangMultimedia Tools and Applications · Hangzhou Dianzi University · University of Technology Sydney
  3. 2020
    GraphSAIL: Graph Structure Aware Incremental Learning for Recommender SystemsYishi Xu, Yingxue Zhang, Wei Guo … Mark CoatesCIKM · Université de Montréal · Huawei Technologies (Canada) · +2
    PDF ↗
  4. 2020
    Continual Unsupervised Domain Adaptation for Semantic SegmentationJoonhyuk Kim, Sahng-Min Yoo, Gyeong-Moon Park, Jong-Hwan KimarXiv
    PDF ↗
  5. 2020
    Continual Learning for Neural Semantic ParsingVladislav Lialin, Rahul Goel, Andrey Simanovsky … Rushin ShaharXiv · University of Massachusetts Lowell · Google (United States)
    PDF ↗
  6. 2020
    IExpressNet: Facial Expression Recognition with Incremental ClassesJunjie Zhu, Bingjun Luo, Sicheng Zhao … Yue GaoACM International Conference on Multimedia · Tsinghua University · University of California, Berkeley · +1
  7. 2020
    Mitigating Catastrophic Forgetting In Adaptive Class Incremental Extreme Learning Machine Through Neuron ClusteringGhalib Ahmed Tahir, Chu Kiong LooIEEE International Conference on Systems, Man, and Cybern… · University of Malaya
  8. 2020
    Prototype-Based Discriminative Feature Representation for Class-incremental Cross-modal RetrievalShaoquan Zhu, Yong Feng, Mingliang Zhou … Ran WeiInternational Journal of Pattern Recognition and Artifici… · Ministry of Education of the People's Republic of China · Chongqing University · +3
  9. 2020
    The Effectiveness of Memory Replay in Large Scale Continual LearningYogesh Balaji, Mehrdad Farajtabar, Dong Yin … Ang LiarXiv
    PDF ↗
  10. 2020
    Meta-Consolidation for Continual LearningK J Joseph, Vineeth N BalasubramanianNeurIPS · Indian Institute of Technology Hyderabad
    PDF ↗
  11. 2020
    Continual Learning Of Predictive Models In Video Sequences Via Variational AutoencodersDamian Campo, Giulia Slavic, Mohamad Baydoun … Carlo S. RegazzoniInternational Conference on Information Photonics · University of Genoa
    PDF ↗
  12. 2020
    Deep Inhomogeneous Regularization For Transfer LearningWen Wang, Wei Zhai, Yang CaoICIP · University of Science and Technology of China
  13. 2020
    Class Incremental Learning With Task-SelectionEun Sung Kim, Jung Uk Kim, Sangmin Lee … Yong Man RoICIP · Korea Advanced Institute of Science and Technology · Korea Electric Power Corporation (South Korea)
  14. 2020
    Faster ILOD: Incremental Learning for Object Detectors based on Faster RCNNCan Peng, Kun Zhao, Brian C. LovellPattern Recognition Letters · The University of Queensland
    PDF ↗
  15. 2020
    Metaplasticity in Multistate Memristor Synaptic NetworksFatima Tuz Zohora, Abdullah M. Zyarah, Nicholas Soures, Dhireesha KudithipudiInternational Symposium on Circuits and Systems · The University of Texas at San Antonio · Rochester Institute of Technology
    PDF ↗
  16. 2020
    Neurocoder: Learning General-Purpose Computation Using Stored Neural ProgramsHung Lê, Svetha VenkatesharXiv · Deakin University
    PDF ↗
  17. 2020
    Memory-Latency-Accuracy Trade-Offs for Continual Learning on a RISC-V Extreme-Edge NodeLeonardo Ravaglia, Manuele Rusci, Alessandro Capotondi … Luca BeniniIEEE Workshop on Signal Processing Systems · University of Bologna · University of Modena and Reggio Emilia · +1
    PDF ↗
  18. 2020
    Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the JobBing Liu, Sahisnu MazumderarXiv · University of Illinois Chicago
    PDF ↗
  19. 2020
    ADER: Adaptively Distilled Exemplar Replay Towards Continual Learning for Session-based RecommendationFei Mi, Xiaoyu Lin, Boi FaltingsRecSys · École Polytechnique Fédérale de Lausanne
    PDF ↗
  20. 2020
    Exploring Neuromodulation for Dynamic LearningAnurag Daram, Ángel Yanguas-Gil, Dhireesha KudithipudiFrontiers · The University of Texas at San Antonio · Argonne National Laboratory
  21. 2020
    Incremental learning based multi-domain adaptation for object detectionXing Wei, Shaofan Liu, Yaoci Xiang … Yang LuKnowledge-Based Systems · Hefei University of Technology
  22. 2020
    Few-Shot Unsupervised Continual Learning through Meta-ExamplesAlessia Bertugli, Stefano Vincenzi, Simone Calderara, Andrea PasseriniarXiv · University of Trento · University of Modena and Reggio Emilia
    PDF ↗
  23. 2020
    Incremental learning model inspired in Rehearsal for deep convolutional networksDavid A. Muñoz, Camilo Narváez, Carlos Cobos … Francisco HerreraKnowledge-Based Systems · University of Cauca · Universidad de Granada · +1
  24. 2020
    Measuring Information Transfer in Neural NetworksXiao Zhang, Xingjian Li, Dejing Dou, Ji WuarXiv · Tsinghua University · Baidu (China)
    PDF ↗
  25. 2020
    Meta-Learning with Sparse Experience Replay for Lifelong Language LearningNithin Holla, Pushkar Mishra, Helen Yannakoudakis, Ekaterina ShutovaarXiv · Meta (Israel) · King's College London · +1
    PDF ↗
  26. 2020
    Routing Networks with Co-training for Continual LearningMark Collier, Efi Kokiopoulou, Andréa Gesmundo, Jesse BerentarXiv · Google (United States)
    PDF ↗
  27. 2020
    Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language ModellingTsendsuren MunkhdalaiarXiv · Microsoft Research (United Kingdom)
    PDF ↗
  28. 2020
    Compression-aware Continual Learning using Singular Value DecompositionVarigonda Pavan Teja, Priyadarshini PandaarXiv · Yale University
    PDF ↗
  29. 2020
    Keynote Lecture - Building Knowledge For AI AgentsWith Reinforcement LearningDoina PrecupIEEE 16th International Conference on Intelligent Compute… · Google DeepMind (United Kingdom) · McGill University
  30. 2020
    Lifelong Object DetectionZhou Wang, Shiyu Chang, Norma Sosa … David CoxarXiv
    PDF ↗
  31. 2020
    Adversarial Shapley Value Experience Replay for Task-Free Continual LearningDongsub Shim, Zheda Mai, Jihwan Jeong … Jongseong JangAAAI · University of Toronto
    PDF ↗
  32. 2020
    CUE: A unified spiking neuron model of short-term and long-term memory.Jan Gosmann, Chris EliasmithPsychological Review · University of Waterloo
  33. 2020
    Brain-inspired replay for continual learning with artificial neural networksGido M. van de Ven, Hava T. Siegelmann, Andreas S. ToliasNature Communications · Baylor College of Medicine · University of Cambridge · +3
  34. 2020
    Catastrophic Interference in Predictive Neural Network Models of Distributional SemanticsWilla Mannering, Michael N. JonesComputational Brain & Behavior · Indiana University Bloomington
  35. 2020
    Internet of emotional people: Towards continual affective computing cross cultures via audiovisual signalsJing Han, Zixing Zhang, Maja Pantić, Björn W. SchullerFuture Generation Computer Systems · University of Augsburg · Imperial College London
  36. 2020
    SLER: Self-generated long-term experience replay for continual reinforcement learningChunmao Li, Li Yang, Yin-Liang ZHAO … Xupeng GengApplied Intelligence
  37. 2020
    Deep online classification using pseudo-generative modelsA. G. Besedin, Pierre Blanchart, Michel Crucianu, Marin FerecatuComputer Vision and Image Understanding · Conservatoire National des Arts et Métiers · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · +2
  38. 2020
    Emergence of Stable Synaptic Clusters on Dendrites Through Synaptic RewiringThomas Limbacher, Robert LegensteinFrontiers · Graz University of Technology
  39. 2020
    Continual Learning for Affective Robotics: Why, What and How?Nikhil Churamani, Sinan Kalkan, Hatice GüneşIEEE International Conference on Robot and Human Interact… · University of Cambridge · Middle East Technical University
  40. 2020
    Lifelong NavigationBo Liu, Xuesu Xiao, Peter StonearXiv · The University of Texas at Austin
    PDF ↗
  41. 2020
    La-MAML: Look-ahead Meta Learning for Continual LearningGunshi Gupta, Karmesh Yadav, Liam PaullNeurIPS · Carnegie Mellon University · Université de Montréal
    PDF ↗
  42. 2020PDF ↗
  43. 2020
  44. 2020
    Multilayer Neuromodulated Architectures for Memory-Constrained Online Continual LearningSandeep Madireddy, Ángel Yanguas-Gil, Prasanna BalaprakasharXiv · Argonne National Laboratory
    PDF ↗
  45. 2020
    Lifelong Policy Gradient Learning of Factored Policies for Faster Training Without ForgettingJorge A. Mendez, Boyu Wang, Eric EatonNeurIPS · California University of Pennsylvania · University of Pennsylvania · +1
    PDF ↗
  46. 2020
    Lifelong Learning using Eigentasks: Task Separation, Skill Acquisition, and Selective TransferAswin Raghavan, Jesse Hostetler, Indranil Sur … Ajay DivakaranarXiv · SRI International
    PDF ↗
  47. 2020
    RATT: Recurrent Attention to Transient Tasks for Continual Image CaptioningRiccardo Del Chiaro, Bartłomiej Twardowski, Andrew D. Bagdanov, Joost van de WeijerNeurIPS
    PDF ↗
  48. 2020
    Disentanglement of Color and Shape Representations for Continual LearningDavid Berga, Marc Masana, Joost van de WeijerarXiv
    PDF ↗
  49. 2020
    Online Continual Learning from Imbalanced DataA. Chrysakis, Marie-Francine MoensICML
  50. 2020
    Batch-level Experience Replay with Review for Continual LearningZheda Mai, Hyunwoo Kim, Jihwan Jeong, Scott SannerarXiv · University of Toronto
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.