Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

460 papers of 8,653 · showing 51–100Sort Recent · Most cited
  1. 2020
    Gradient Regularized Contrastive Learning for Continual Domain AdaptationShixiang Tang, Peng Su, Dapeng Chen, Wanli OuyangAAAI · The University of Sydney · Chinese University of Hong Kong · +1
    PDF ↗
  2. 2020
    I3DOL: Incremental 3D Object Learning without Catastrophic ForgettingJiahua Dong, Yang Cong, Gan Sun … Lichen WangAAAI · Shenyang Institute of Automation · University of Chinese Academy of Sciences · +2
    PDF ↗
  3. 2020
    Multi-Domain Multi-Task Rehearsal for Lifelong LearningFan Lyu, Shuai Wang, Wei Feng … Song WangAAAI · Tianjin University · University of South Carolina · +1
    PDF ↗
  4. 2020
    Incremental Embedding Learning via Zero-Shot TranslationKun Wei, Cheng Deng, Xu Yang, Maosen LiAAAI · Xidian University
    PDF ↗
  5. 2020
    Synaptic metaplasticity in binarized neural networksAxel Laborieux, Maxence Ernoult, Tifenn Hirtzlin, Damien QuerliozNature Communications · Centre National de la Recherche Scientifique · Université Paris-Saclay · +2
    PDF ↗
  6. 2020
    Memory-Efficient Class-Incremental Learning for Image ClassificationHanbin Zhao, Hui Wang, Yongjian Fu … Xi LiTNNLS · Zhejiang University of Science and Technology · Shanghai Advanced Research Institute
    PDF ↗
  7. 2020
    3D_DEN: Open-Ended 3-D Object Recognition Using Dynamically Expandable NetworksSudhakaran Jain, Hamidreza KasaeiIEEE TCDS · University of Groningen
    PDF ↗
  8. 2020
    Sequential Targeting: an incremental learning approach for data imbalance in text classificationJoel Jang, Yoonjeon Kim, Kyoung-Ho Choi, Sungho SuhExpert Systems with Applications · Korea Advanced Institute of Science and Technology · Naver (South Korea) · +1
    PDF ↗
  9. 2020
    Beneficial Perturbation Network for Designing General Adaptive Artificial Intelligence SystemsShixian Wen, Amanda Rios, Yunhao Ge, Laurent IttiTNNLS · University of Southern California
    PDF ↗
  10. 2020
    Lifelong Incremental Reinforcement Learning With Online Bayesian InferenceZhi Wang, Chunlin Chen, Daoyi DongTNNLS · Nanjing University · University of Canberra · +1
    PDF ↗
  11. 2020
    Prediction Error-Driven Memory Consolidation for Continual Learning: On the Case of Adaptive Greenhouse ModelsGuido Schillaci, Uwe Schmidt, Luis MirandaKünstliche Intell. · Scuola Superiore Sant'Anna · Humboldt-Universität zu Berlin · +1
    PDF ↗
  12. 2020
    SpaceNet: Make Free Space For Continual LearningGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiyNeurocomputing · Eindhoven University of Technology · University of Twente
    PDF ↗
  13. 2020
    Learning Invariant Representation for Continual LearningGhada Sokar, Decebal Constantin Mocanu, Mykola PechenizkiyarXiv · Eindhoven University of Technology · University of Twente
    PDF ↗
  14. 2020
    Rethinking Experience Replay: a Bag of Tricks for Continual LearningPietro Buzzega, Matteo Boschini, Angelo Porrello, Simone CalderaraICPR · University of Modena and Reggio Emilia
    PDF ↗
  15. 2020
    Class-incremental Learning with Pre-allocated Fixed ClassifiersFederico Pernici, Matteo Bruni, Claudio Baecchi … Alberto Del BimboICPR · Florence (Netherlands) · University of Florence
    PDF ↗
  16. 2020
    Sequential Domain Adaptation through Elastic Weight Consolidation for Sentiment AnalysisAvinash Madasu, Anvesh Rao VijjiniICPR · Samsung (United States) · Samsung (India)
    PDF ↗
  17. 2020
    ARCADe: A Rapid Continual Anomaly DetectorAhmed Frikha, Denis Krompaß, Volker TrespICPR · Siemens (Germany)
    PDF ↗
  18. 2020
    Pseudo Rehearsal using non photo-realistic imagesBhasker Sri Harsha Suri, Kalidas YeturuICPR · Indian Institute of Technology Tirupati
    PDF ↗
  19. 2020
    AdapterFusion: Non-Destructive Task Composition for Transfer LearningJonas Pfeiffer, Aishwarya Kamath, Andreas Rücklé … Iryna GurevychEACL · Technische Universität Darmstadt · Supélec · +5
    PDF ↗
  20. 2020
    K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersRuize Wang, Duyu Tang, Nan Duan … Ming ZhouACL · Fudan University · Microsoft (United States) · +1
    PDF ↗
  21. 2020
    Continual Learning in Task-Oriented Dialogue SystemsAndrea Madotto, Zhaojiang Lin, Zhenpeng Zhou … Zhiguang WangEMNLP · Hong Kong University of Science and Technology · Meta (Israel) · +1
    PDF ↗
  22. 2020
    InfoMax-GAN: Improved Adversarial Image Generation via Information Maximization and Contrastive LearningKwot Sin Lee, Ngoc-Trung Tran, Ngai‐Man CheungWACV · University of Cambridge · Snap (United States) · +1
    PDF ↗
  23. 2020
    Multilingual Machine Translation: Closing the Gap between Shared and Language-specific Encoder-DecodersCarlos Escolano, Marta R. Costa‐jussà, José A. R. Fonollosa, Mikel ArtetxeEACL · Universitat Politècnica de Catalunya · University of the Basque Country · +1
    PDF ↗
  24. 2020
    Learning Adaptive Embedding Considering Incremental ClassYang Yang, Zhen-Qiang Sun, Hengshu Zhu … Jian YangTKDE · Nanjing University of Science and Technology · Nanjing Normal University · +4
    PDF ↗
  25. 2020
    Continual Representation Learning for Biometric IdentificationBo Zhao, Shixiang Tang, Dapeng Chen … Rui ZhaoWACV · Group Sense (China) · University of Edinburgh · +1
    PDF ↗
  26. 2020
    Prototype-based Incremental Few-Shot SegmentationFabio Cermelli, Massimiliano Mancini, Yongqin Xian … Barbara CaputoBMVC
    PDF ↗
  27. 2020
    SPACE: Structured Compression and Sharing of Representational Space for Continual LearningGobinda Saha, Isha Garg, Aayush Ankit, Kaushik RoyIEEE Access · Purdue University West Lafayette
    PDF ↗
  28. 2020
    Explaining How Deep Neural Networks Forget by Deep VisualizationGiang V. Nguyen, Chen Shuan, Tae Joon Jun, Daeyoung KimSpringer LNCS · Korea Advanced Institute of Science and Technology · Ansan University
    PDF ↗
  29. 2020
    Class-incremental Learning with Rectified Feature-Graph PreservationCheng-Hsun Lei, Yi-Hsin Chen, Wen-Hsiao Peng, Wei-Chen ChiuSpringer LNCS · National Yang Ming Chiao Tung University
    PDF ↗
  30. 2020
    NASIL: Neural Network Architecture Searching for Incremental Learning in Image ClassificationXianya Fu, Wenrui Li, Qiurui Chen … Rui WangSpringer CCIS · Beihang University · State Key Joint Laboratory of Environment Simulation and Pollution Control
  31. 2020
    An Empirical Study of Incremental Learning in Neural Network with Noisy Training SetShovik Ganguly, Atrayee Chatterjee, Debasmita Bhoumik, Ritajit MajumdarSpringer LNCS · University of Calcutta · Indian Statistical Institute
    PDF ↗
  32. 2020
    Learn to Bind and Grow Neural StructuresAzhar Shaikh, Nishant SinhaCOMAD/CODS · PES University
    PDF ↗
  33. 2020
    Efficient Continual Learning with Modular Networks and Task-Driven PriorsTom Véniat, Ludovic Denoyer, Marc’Aurelio RanzatoICLR · Meta (United States)
    PDF ↗
  34. 2020
    Detecting Changes and Avoiding Catastrophic Forgetting in Dynamic Partially Observable EnvironmentsJeffery Dick, Paweł Ładosz, Eseoghene Ben-Iwhiwhu … Andrea SoltoggioFrontiers · Loughborough University · Teikyo University · +1
  35. 2020
    A New Artificial Immune System Based on Continuous Learning for Pattern RecognitionSimone F. Souza, Fernando Parra dos Anjos Lima, Fábio Roberto ChavaretteRevista de Informática Teórica e Aplicada · Universidade do Estado de Mato Grosso · Instituto Federal de Educação, Ciência e Tecnologia de Mato Grosso · +1
  36. 2020
    Selective Forgetting of Deep Networks at a Finer Level than SamplesTomohiro Hayase, Suguru Yasutomi, Takashi KatoharXiv
    PDF ↗
  37. 2020
  38. 2020
  39. 2020
    Lifelong Machine Learning for Regional-Based Image Classification in Open DatasetsHashem Alyami, Abdullah Alharbi, M. Irfan UddinSymmetry · Taif University · Kohat University of Science and Technology
  40. 2020
    Consequences of Slow Neural Dynamics for Incremental LearningShima Rahimi Moghaddam, Fanjun Bu, Christopher J. HoneyarXiv
    PDF ↗
  41. 2020
    River: machine learning for streaming data in PythonJacob Montiel, Max Halford, Saulo Martiello Mastelini … Albert BifetJMLR · University of Waikato · Universidade de São Paulo · +14
    PDF ↗
  42. 2020
    A Comprehensive Study of Class Incremental Learning Algorithms for Visual TasksEden Belouadah, Adrian Popescu, Ioannis KanellosNeural Networks · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · +2
    PDF ↗
  43. 2020
    Incremental Learning for Autonomous Navigation of Mobile Robots based on Deep Reinforcement LearningManh Luong, Cuong PhamJournal of Intelligent & Robotic Systems · VinUniversity · Posts and Telecommunications Institute of Technology
  44. 2020
    Reset-Free Lifelong Learning with Skill-Space PlanningKevin Lü, Aditya Grover, Pieter Abbeel, Igor MordatchICLR · University of California, Berkeley · Stanford University · +1
    PDF ↗
  45. 2020
    Extending Conditional Convolution Structures For Enhancing Multitasking Continual LearningCheng-Hao Tu, Cheng-En Wu, Chu-Song ChenAsia-Pacific Signal and Information Processing Associatio…
  46. 2020
    Cuepervision: self-supervised learning for continuous domain adaptation without catastrophic forgettingMark Schutera, Frank M. Hafner, Jochen Abhau … Markus ReischlImage and Vision Computing · Karlsruhe Institute of Technology · ZF Friedrichshafen (Germany)
  47. 2020
    Association: Remind Your GAN not to ForgetYi Gu, Jie Li, Yuting Gao … Zhang, ZiruiarXiv
    PDF ↗
  48. 2020
    Enhancing network modularity to mitigate catastrophic forgettingLu Chen, Masayuki MurataApplied Network Science · Kyoto Institute of Technology · Osaka Health Science University · +1
  49. 2020
    Continual learning with direction-constrained optimizationYunfei Teng, A. Choromańska, Murray CampbellarXiv
  50. 2020
    Generalized Variational Continual LearningNoel Loo, Siddharth Swaroop, Richard E. TurnerICLR · University of Cambridge
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.