Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

868 papers of 11,817 · showing 51–100Sort Recent · Most cited
  1. 2021
    Task-Oriented Dialogue System as Natural Language GenerationWeizhi Wang, Zhirui Zhang, Junliang Guo … Weihua LuoSIGIR · University of California, Santa Barbara · Tencent (China) · +2
    PDF ↗
  2. 2021
    Multiband VAE: Latent Space Alignment for Knowledge Consolidation in Continual LearningKamil Rafał Deja, Paweł Wawrzyński, Wojciech Masarczyk … T. P. TrzcinskiIJCAI · Warsaw University of Technology · The University of Texas at Austin · +2
    PDF ↗
  3. 2021
    Deep learning via message passing algorithms based on belief propagationCarlo Lucibello, Fabrizio Pittorino, Gabriele Perugini, Riccardo ZecchinaMachine Learning Science and Technology · Bocconi University · Politecnico di Torino
    PDF ↗
  4. 2021
    Same State, Different Task: Continual Reinforcement Learning without InterferenceSamuel Kessler, Jack Parker-Holder, Philip Ball … Stephen RobertsAAAI · University of Oxford
    PDF ↗
  5. 2021
    Hierarchical Prototype Networks for Continual Graph Representation LearningXikun Zhang, Dongjin Song, Dacheng TaoTPAMI · The University of Sydney · University of Connecticut
    PDF ↗
  6. 2021
    From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model CompressionRunxin Xu, Fuli Luo, Chengyu Wang … Fei HuangAAAI · Peking University · Alibaba Group (United States)
    PDF ↗
  7. 2021
    Static-Dynamic Co-Teaching for Class-Incremental 3D Object DetectionNa Zhao, Gim Hee LeeAAAI · National University of Singapore
    PDF ↗
  8. 2021
    Gradient-based Novelty Detection Boosted by Self-supervised Binary ClassificationJingbo Sun, Li Yang, Jiaxin Zhang … Yu CaoAAAI · Arizona State University · Oak Ridge National Laboratory · +1
    PDF ↗
  9. 2021
    Lifelong Generative Modelling Using Dynamic Expansion Graph ModelFei Ye, Adrian G. BorşAAAI · University of York
    PDF ↗
  10. 2021
    Lifelong Hyper-Policy Optimization with Multiple Importance Sampling RegularizationPierre Liotet, Francesco Vidaich, Alberto Maria Metelli, Marcello RestelliAAAI · Politecnico di Milano · University of Padua
    PDF ↗
  11. 2021
    Reducing Catastrophic Forgetting in Self Organizing Maps with Internally-Induced Generative ReplayHitesh Vaidya, Travis Desell, Alexander G. OrorbiaAAAI · Rochester Institute of Technology
    PDF ↗
  12. 2021
    Learning to Transfer with von Neumann Conditional DivergenceAmmar Shaker, Shujian Yu, Daniel Oñoro-RubioAAAI · Sharp Laboratories of Europe (United Kingdom) · Centre for Arctic Gas Hydrate, Environment and Climate · +2
    PDF ↗
  13. 2021
    Model architecture can transform catastrophic forgetting into positive transferMiguel Ruiz-GarcíaScientific Reports · Universidad Carlos III de Madrid
    PDF ↗
  14. 2021
    Multi-View Correlation Distillation for Incremental Object DetectionDongbao Yang, Yu Zhou, Aoting Zhang … Qixiang YePattern Recognition · Chinese Academy of Sciences · Institute of Information Engineering · +1
    PDF ↗
  15. 2021
    Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen‐Yu Lee … Tomas PfisterCVPR · Universidad del Noreste · Google (United States)
    PDF ↗
  16. 2021
    DyTox: Transformers for Continual Learning with DYnamic TOken eXpansionArthur Douillard, Alexandre Ramé, Guillaume Couairon, Matthieu CordCVPR · Sorbonne Université · Valeo (France)
    PDF ↗
  17. 2021
    Self-Supervised Models are Continual LearnersEnrico Fini, Victor G. Turrisi da Costa, Xavier Alameda-Pineda … Julien MairalCVPR · University of Trento · Institut national de recherche en sciences et technologies du numérique · +1
    PDF ↗
  18. 2021
    Rethinking Architecture Design for Tackling Data Heterogeneity in Federated LearningLiangqiong Qu, Yuyin Zhou, Paul Pu Liang … Daniel L. RubinCVPR · Stanford University · University of California, Santa Cruz · +2
    PDF ↗
  19. 2021
    GCR: Gradient Coreset based Replay Buffer Selection for Continual LearningRishabh Tiwari, Krishnateja Killamsetty, Rishabh Iyer, Pradeep ShenoyCVPR · Indian Institute of Technology Dhanbad · The University of Texas at Dallas
    PDF ↗
  20. 2021
    Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental LearningYujun Shi, Kuangqi Zhou, Jian Liang … Vincent Y. F. TanCVPR · National University of Singapore · Chinese Academy of Sciences · +1
    PDF ↗
  21. 2021
    Towards Better Plasticity-Stability Trade-off in Incremental Learning: A Simple Linear ConnectorGuoliang Lin, Hanlu Chu, Hanjiang LaiCVPR · Sun Yat-sen University · South China Normal University
    PDF ↗
  22. 2021
    Incremental Learning in Semantic Segmentation from Image LabelsFabio Cermelli, Dario Fontanel, Antonio Tavera … Barbara CaputoCVPR · Politecnico di Torino · Italian Institute of Technology
    PDF ↗
  23. 2021
    Continually Learning Self-Supervised Representations with Projected Functional RegularizationAlex Gomez-Villa, Bartłomiej Twardowski, Yu Lu … Joost van de WeijerCVPR · Universitat Autònoma de Barcelona · Tianjin University of Technology · +1
    PDF ↗
  24. 2021
    Ex-Model: Continual Learning from a Stream of Trained ModelsAntonio Carta, Andrea Cossu, Vincenzo Lomonaco, Davide BacciuCVPR · University of Pisa · Scuola Normale Superiore
    PDF ↗
  25. 2021
    DO-GAN: A Double Oracle Framework for Generative Adversarial NetworksAye Phyu Phyu Aung, Xinrun Wang, Runsheng Yu … Xiaoli LiCVPR · Agency for Science, Technology and Research · Nanyang Technological University · +1
    PDF ↗
  26. 2021
    CSG0: Continual Urban Scene Generation with Zero ForgettingHimalaya Jain, Tuan-Hung Vu, Patrick Pérez, Matthieu CordCVPR · Valeo (France)
    PDF ↗
  27. 2021
    Re-using Adversarial Mask Discriminators for Test-time Training under Distribution ShiftsGabriele Valvano, Andrea Leo, Sotirios A. TsaftarisThe Journal of Machine Learning for Biomedical Imaging · University of Pisa · IMT School for Advanced Studies Lucca · +1
    PDF ↗
  28. 2021
    Search-Based Task Planning with Learned Skill Effect Models for Lifelong Robotic ManipulationJacky Liang, Mohit Sharma, Alex LaGrassa … Oliver KroemerICRA · Carnegie Mellon University
    PDF ↗
  29. 2021
    AirLoop: Lifelong Loop Closure DetectionDasong Gao, Chen Wang, Sebastian SchererICRA · Carnegie Mellon University
    PDF ↗
  30. 2021
    Learning Spatiotemporal Occupancy Grid Maps for Lifelong Navigation in Dynamic ScenesHugues Thomas, Matthieu Gallet de Saint Aurin, Jian Zhang, Timothy D. BarfootICRA · University of Toronto
    PDF ↗
  31. 2021
    Model-Based Reinforcement Learning Framework of Online Network Resource AllocationBahador Bakhshi, Josep Mangues‐BafalluyICC 2022 - IEEE International Conference on Communications · Centre Tecnologic de Telecomunicacions de Catalunya
    PDF ↗
  32. 2021
    Class-incremental Learning using a Sequence of Partial Implicitly Regularized ClassifiersSobirdzhon Bobiev, Albina Khusainova, Adil Khan, S. M. Ahsan Kazmi... International Florida Artificial Intelligence Researc… · Innopolis University · University of the West of England
    PDF ↗
  33. 2021
    Software engineering for Responsible AI: An empirical study and operationalised patternsQinghua Lu, Liming Zhu, Xiwei Xu … Conrad SandersonIEEE/ACM 44th International Conference on Software Engine… · Commonwealth Scientific and Industrial Research Organisation
    PDF ↗
  34. 2021
    Quantum Continual Learning Overcoming Catastrophic ForgettingWenjie Jiang, Zhide Lu, Dong-Ling DengChinese Physics Letters · Tsinghua University · ShangHai JiAi Genetics & IVF Institute
    PDF ↗
  35. 2021
    Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic EnvironmentsAbhiram Iyer, Karan Grewal, Akash Velu … Subutai AhmadFrontiers · Carnegie Mellon University · Stanford University · +1
    PDF ↗
  36. 2021
    An Adapter Based Pre-Training for Efficient and Scalable Self-Supervised Speech Representation LearningSamuel Kessler, Bethan Thomas, Salah KaroutICASSP · University of Oxford · Huawei Technologies (United Kingdom)
    PDF ↗
  37. 2021
    Towards Lifelong Learning of Multilingual Text-to-Speech SynthesisMu Yang, Shaojin Ding, Tianlong Chen … Zhangyang WangICASSP · The University of Texas at Dallas · Texas A&M University · +2
    PDF ↗
  38. 2021
    Continual Learning for Real-World Autonomous Systems: Algorithms, Challenges and FrameworksKhadija Shaheen, Muhammad Abdullah Hanif, Osman Hasan, Muhammad ShafiqueJournal of Intelligent & Robotic Systems · National University of Sciences and Technology · New York University Abu Dhabi
    PDF ↗
  39. 2021
    Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge DistillationTiantian Zhang, Xueqian Wang, Bin Liang, Bo YuanTNNLS · University Town of Shenzhen · Tsinghua University
    PDF ↗
  40. 2021
    From partners to populations: A hierarchical Bayesian account of coordination and conventionRobert D. Hawkins, Michael Franke, Michael C. Frank … Noah D. GoodmanPsychological Review · Princeton University · Osnabrück University · +3
    PDF ↗
  41. 2021
    Unsupervised Continual Learning in Streaming EnvironmentsAndri Ashfahani, Mahardhika PratamaTNNLS · Nanyang Technological University · University of South Australia
    PDF ↗
  42. 2021
    Stable Lifelong Learning: Spiking neurons as a solution to instability in plastic neural networksSamuel Schmidgall, Joe HaysNeuro-Inspired Computational Elements Conference · United States Naval Research Laboratory
    PDF ↗
  43. 2021
    Is Class-Incremental Enough for Continual Learning?Andrea Cossu, Gabriele Graffieti, Lorenzo Pellegrini … Vincenzo LomonacoFrontiers · University of Pisa · Scuola Normale Superiore · +1
    PDF ↗
  44. 2021
    Lifelong 3D Object Recognition and Grasp Synthesis Using Dual Memory Recurrent Self-Organization NetworksKrishnakumar Santhakumar, Hamidreza KasaeiNeural Networks · University of Groningen
    PDF ↗
  45. 2021
    Recursive Least-Squares Estimator-Aided Online Learning for Visual TrackingJin Gao, Yan Lu, Xiaojuan Qi … Weiming HuTPAMI · Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence · +5
    PDF ↗
  46. 2021
    Deep Bayesian Unsupervised Lifelong LearningTingting Zhao, Zifeng Wang, Aria Masoomi, Jennifer DyNeural Networks · Bryant University · Bryan College · +1
    PDF ↗
  47. 2021
    Preservation of the Global Knowledge by Not-True Distillation in Federated LearningGihun Lee, Minchan Jeong, Yongjin Shin … Se-Young YunNeurIPS
    PDF ↗
  48. 2021
    Composable Sparse Fine-Tuning for Cross-Lingual TransferAlan Ansell, Edoardo Maria Ponti, Anna Korhonen, Ivan VulićACL · University of Cambridge · Language Science (South Korea) · +2
    PDF ↗
  49. 2021
    Continual Learning for Blind Image Quality AssessmentWeixia Zhang, Dingquan Li, Chao Ma … Kede MaTPAMI · Shanghai Jiao Tong University · Peng Cheng Laboratory · +1
    PDF ↗
  50. 2021
    Distilled Replay: Overcoming Forgetting through Synthetic SamplesAndrea Rosasco, Antonio Carta, Andrea Cossu … Davide BacciuSpringer LNCS · University of Pisa · Scuola Normale Superiore
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.