Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

661 papers of 8,653 · showing 51–100Sort Recent · Most cited
  1. 2021
    Reducing Catastrophic Forgetting in Self Organizing Maps with Internally-Induced Generative ReplayHitesh Vaidya, Travis Desell, Alexander G. OrorbiaAAAI · Rochester Institute of Technology
    PDF ↗
  2. 2021
    Learning to Transfer with von Neumann Conditional DivergenceAmmar Shaker, Shujian Yu, Daniel Oñoro-RubioAAAI · Sharp Laboratories of Europe (United Kingdom) · Centre for Arctic Gas Hydrate, Environment and Climate · +2
    PDF ↗
  3. 2021
    Model architecture can transform catastrophic forgetting into positive transferMiguel Ruiz-GarcíaScientific Reports · Universidad Carlos III de Madrid
    PDF ↗
  4. 2021
    Multi-View Correlation Distillation for Incremental Object DetectionDongbao Yang, Yu Zhou, Aoting Zhang … Qixiang YePattern Recognition · Chinese Academy of Sciences · Institute of Information Engineering · +1
    PDF ↗
  5. 2021
    Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit RecognitionNikhil Churamani, Özgür Kara, Hatice GüneşIEEE Transactions · University of Cambridge · Boğaziçi University
    PDF ↗
  6. 2021
    Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen‐Yu Lee … Tomas PfisterCVPR · Universidad del Noreste · Google (United States)
    PDF ↗
  7. 2021
    DyTox: Transformers for Continual Learning with DYnamic TOken eXpansionArthur Douillard, Alexandre Ramé, Guillaume Couairon, Matthieu CordCVPR · Sorbonne Université · Valeo (France)
    PDF ↗
  8. 2021
    Self-Supervised Models are Continual LearnersEnrico Fini, Victor G. Turrisi da Costa, Xavier Alameda-Pineda … Julien MairalCVPR · University of Trento · Institut national de recherche en sciences et technologies du numérique · +1
    PDF ↗
  9. 2021
    Rethinking Architecture Design for Tackling Data Heterogeneity in Federated LearningLiangqiong Qu, Yuyin Zhou, Paul Pu Liang … Daniel L. RubinCVPR · Stanford University · University of California, Santa Cruz · +2
    PDF ↗
  10. 2021
    GCR: Gradient Coreset based Replay Buffer Selection for Continual LearningRishabh Tiwari, Krishnateja Killamsetty, Rishabh Iyer, Pradeep ShenoyCVPR · Indian Institute of Technology Dhanbad · The University of Texas at Dallas
    PDF ↗
  11. 2021
    Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental LearningYujun Shi, Kuangqi Zhou, Jian Liang … Vincent Y. F. TanCVPR · National University of Singapore · Chinese Academy of Sciences · +1
    PDF ↗
  12. 2021
    Towards Better Plasticity-Stability Trade-off in Incremental Learning: A Simple Linear ConnectorGuoliang Lin, Hanlu Chu, Hanjiang LaiCVPR · Sun Yat-sen University · South China Normal University
    PDF ↗
  13. 2021
    Incremental Learning in Semantic Segmentation from Image LabelsFabio Cermelli, Dario Fontanel, Antonio Tavera … Barbara CaputoCVPR · Politecnico di Torino · Italian Institute of Technology
    PDF ↗
  14. 2021
    Continually Learning Self-Supervised Representations with Projected Functional RegularizationAlex Gomez-Villa, Bartłomiej Twardowski, Yu Lu … Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · Tianjin University of Technology · +1
    PDF ↗
  15. 2021
    Lifelong Unsupervised Domain Adaptive Person Re-identification with Coordinated Anti-forgetting and AdaptationZhipeng Huang, Zhizheng Zhang, Cuiling Lan … Zheng-Jun ZhaCVPR · University of Science and Technology of China · Microsoft Research (United Kingdom)
    PDF ↗
  16. 2021
    Ex-Model: Continual Learning from a Stream of Trained ModelsAntonio Carta, Andrea Cossu, Vincenzo Lomonaco, Davide BacciuCVPR · University of Pisa · Scuola Normale Superiore
    PDF ↗
  17. 2021
    CSG0: Continual Urban Scene Generation with Zero ForgettingHimalaya Jain, Tuan-Hung Vu, Patrick Pérez, Matthieu CordCVPR · Valeo (France)
    PDF ↗
  18. 2021
    Search-Based Task Planning with Learned Skill Effect Models for Lifelong Robotic ManipulationJacky Liang, Mohit Sharma, Alex LaGrassa … Oliver KroemerICRA · Carnegie Mellon University
    PDF ↗
  19. 2021
    AirLoop: Lifelong Loop Closure DetectionDasong Gao, Chen Wang, Sebastian SchererICRA · Carnegie Mellon University
    PDF ↗
  20. 2021
    Class-incremental Learning using a Sequence of Partial Implicitly Regularized ClassifiersSobirdzhon Bobiev, Albina Khusainova, Adil Khan, S. M. Ahsan Kazmi... International Florida Artificial Intelligence Researc… · Innopolis University · University of the West of England
    PDF ↗
  21. 2021
    Quantum Continual Learning Overcoming Catastrophic ForgettingWenjie Jiang, Zhide Lu, Dong-Ling DengChinese Physics Letters · Tsinghua University · ShangHai JiAi Genetics & IVF Institute
    PDF ↗
  22. 2021
    Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic EnvironmentsAbhiram Iyer, Karan Grewal, Akash Velu … Subutai AhmadFrontiers · Carnegie Mellon University · Stanford University · +1
    PDF ↗
  23. 2021
    An Adapter Based Pre-Training for Efficient and Scalable Self-Supervised Speech Representation LearningSamuel Kessler, Bethan Thomas, Salah KaroutICASSP · University of Oxford · Huawei Technologies (United Kingdom)
    PDF ↗
  24. 2021
    Towards Lifelong Learning of Multilingual Text-to-Speech SynthesisMu Yang, Shaojin Ding, Tianlong Chen … Zhangyang WangICASSP · The University of Texas at Dallas · Texas A&M University · +2
    PDF ↗
  25. 2021
    Continual Learning Using Lattice-Free MMI for Speech RecognitionHossein Hadian, Arseniy GorinICASSP · NeuroRx Research (Canada)
    PDF ↗
  26. 2021
    Continual Learning for Real-World Autonomous Systems: Algorithms, Challenges and FrameworksKhadija Shaheen, Muhammad Abdullah Hanif, Osman Hasan, Muhammad ShafiqueJournal of Intelligent & Robotic Systems · National University of Sciences and Technology · New York University Abu Dhabi
    PDF ↗
  27. 2021
    Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge DistillationTiantian Zhang, Xueqian Wang, Bin Liang, Bo YuanTNNLS · University Town of Shenzhen · Tsinghua University
    PDF ↗
  28. 2021
    Unsupervised Continual Learning in Streaming EnvironmentsAndri Ashfahani, Mahardhika PratamaTNNLS · Nanyang Technological University · University of South Australia
    PDF ↗
  29. 2021
    Stable Lifelong Learning: Spiking neurons as a solution to instability in plastic neural networksSamuel Schmidgall, Joe HaysNeuro-Inspired Computational Elements Conference · United States Naval Research Laboratory
    PDF ↗
  30. 2021
    Is Class-Incremental Enough for Continual Learning?Andrea Cossu, Gabriele Graffieti, Lorenzo Pellegrini … Vincenzo LomonacoFrontiers · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  31. 2021
    Continual Learning for Pattern Recognizers using Neurogenesis Deep Learning.James Harris, Dylan Fox, Yang Ho … Omar GarcíaSandia National Laboratories (SNL) · Sandia National Laboratories California
  32. 2021
    Lifelong 3D Object Recognition and Grasp Synthesis Using Dual Memory Recurrent Self-Organization NetworksKrishnakumar Santhakumar, Hamidreza KasaeiNeural Networks · University of Groningen
    PDF ↗
  33. 2021
    Graph Few-shot Class-incremental LearningZhen Tan, Kaize Ding, Ruocheng Guo, Huan LiuWSDM · Arizona State University · City University of Hong Kong
    PDF ↗
  34. 2021
    Deep Bayesian Unsupervised Lifelong LearningTingting Zhao, Zifeng Wang, Aria Masoomi, Jennifer DyNeural Networks · Bryant University · Bryan College · +1
    PDF ↗
  35. 2021
    Preservation of the Global Knowledge by Not-True Distillation in Federated LearningGihun Lee, Minchan Jeong, Yongjin Shin … Se-Young YunNeurIPS
    PDF ↗
  36. 2021
    Continual Learning for Blind Image Quality AssessmentWeixia Zhang, Dingquan Li, Chao Ma … Kede MaTPAMI · Shanghai Jiao Tong University · Peng Cheng Laboratory · +1
    PDF ↗
  37. 2021
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
  38. 2021
    Multi-Domain Incremental Learning for Semantic SegmentationPrachi Garg, Rohit Saluja, Vineeth N Balasubramanian … C. V. JawaharWACV · Indian Institute of Technology Hyderabad · Indian Institute of Technology Delhi
    PDF ↗
  39. 2021
    Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic DataKuluhan Binici, Nam Trung Pham, Tulika Mitra, Karianto LemanWACV · Agency for Science, Technology and Research · National University of Singapore · +1
    PDF ↗
  40. 2021
    Unsupervised Continual Learning Via Pseudo LabelsJiangpeng He, Fengqing ZhuSpringer LNCS · Purdue University West Lafayette
    PDF ↗
  41. 2021
    Online Continual Learning Via Candidates VotingJiangpeng He, Fengqing ZhuWACV · Purdue University West Lafayette
    PDF ↗
  42. 2021
    Unsupervised Continual Learning via Self-Adaptive Deep Clustering ApproachMahardhika Pratama, Andri Ashfahani, Edwin LughoferSpringer LNCS · University of South Australia · Nanyang Technological University
    PDF ↗
  43. 2021
    SPeCiaL: Self-Supervised Pretraining for Continual LearningLucas Caccia, Joëlle PineauSpringer LNCS · McGill University
    PDF ↗
  44. 2021
    Continual Learning In Environments With Polynomial Mixing TimesMatthew Riemer, Sharath Chandra Raparthy, Ignacio Cases … Irina RishNeurIPS
    PDF ↗
  45. 2021
    Coarse-To-Fine Incremental Few-Shot LearningXiang Xiang, Yuwen Tan, Qian Wan … Gregory D. HagerSpringer LNCS · Huazhong University of Science and Technology · Johns Hopkins University
    PDF ↗
  46. 2021
    Dataset Knowledge Transfer for Class-Incremental Learning without MemoryHabib Slim, Eden Belouadah, Adrian Popescu, Darian M. OnchişWACV · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +5
    PDF ↗
  47. 2021
    Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement LearningRobin Schiewer, Laurenz WiskottSpringer LNCS · Ruhr University Bochum
    PDF ↗
  48. 2021
    Evaluating Continual Learning Algorithms by Generating 3D Virtual EnvironmentsEnrico Meloni, Alessandro Betti, Lapo Faggi … Stefano MelacciSpringer LNCS · University of Siena · University of Florence
    PDF ↗
  49. 2021
    Improving Scheduled Sampling with Elastic Weight Consolidation for Neural Machine TranslationMichalis Korakakis, Andreas VlachosEMNLP · University of Cambridge
    PDF ↗
  50. 2021
    Continual Learning with Neuron Activation ImportanceSohee Kim, Seungkyu LeeSpringer LNCS · Kyung Hee University
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.