Related work

The foundational work on continual learning, 1991 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

4,574 papers · showing 4201–4250Sort Recent · Most cited
  1. 2021
    Federated Continual Learning with Weighted Inter-client TransferJaehong Yoon, Wonyong Jeong, Giwoong Lee … Sung Ju HwangICML · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  2. 2020
    Class-incremental Learning via Deep Model ConsolidationJunting Zhang, Jie Zhang, Shalini Ghosh … C.‐C. Jay KuoWACV · University of Southern California · California Southern University · +3
    PDF ↗
  3. 2020
    ScaIL: Classifier Weights Scaling for Class Incremental LearningEden Belouadah, Adrian PopescuWACV · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Université Paris-Saclay · +1
    PDF ↗
  4. 2020
    On Catastrophic Interference in Atari 2600 GamesWilliam Fedus, Dibya Ghosh, John D. Martin … Hugo LarochellearXiv
    PDF ↗
  5. 2020PDF ↗
  6. 2019PDF ↗
  7. 2020
    Efficient Continual Learning in Neural Networks with Embedding RegularizationJary Pomponi, Simone Scardapane, Vincenzo Lomonaco, Aurelio UnciniNeurocomputing · Sapienza University of Rome · University of Bologna
    PDF ↗
  8. 2020
    BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong LearningYeming Wen, Dustin Tran, Jimmy BaICLR · University of Toronto · Google (United States)
    PDF ↗
  9. 2020
    Continual Universal Object DetectionXialei Liu, Hao Yang, Avinash Ravichandran … Stefano SoattoarXiv · Universitat Autònoma de Barcelona · Amazon (Germany)
    PDF ↗
  10. 2020
    Incremental Meta-Learning via Indirect Discriminant AlignmentQing Liu, Orchid Majumder, Alessandro Achille … Stefano SoattoECCV · Johns Hopkins University · Amazon (Germany)
    PDF ↗
  11. 2020
    A Novel Incremental Cross-Modal Hashing ApproachDevraj Mandal, Soma BiswasarXiv · Indian Institute of Science Bangalore
    PDF ↗
  12. 2020PDF ↗
  13. 2020
    Ternary Feature Masks: continual learning without any forgettingMarc Masana, T. Tuytelaars, Joost van de WeijerarXiv
    PDF ↗
  14. 2020
    Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed RepresentationsAlexander G. Ororbia, Ankur Mali, C. Lee Giles, Daniel KiferTNNLS · Rochester Institute of Technology · Pennsylvania State University
    PDF ↗
  15. 2020
    Active and Incremental Learning with Weak SupervisionClemens-Alexander Brust, Christoph Käding, Joachim DenzlerKünstliche Intell. · Friedrich Schiller University Jena
    PDF ↗
  16. 2020
    Dissecting Catastrophic Forgetting in Continual Learning by Deep VisualizationGiang Nguyen, Chen Shuan, Thao Do … Daeyoung KimarXiv
    PDF ↗
  17. 2020
    A Neural Dirichlet Process Mixture Model for Task-Free Continual LearningSoochan Lee, Junsoo Ha, Dongsu Zhang, Gunhee KimICLR
    PDF ↗
  18. 2020
    REMIND Your Neural Network to Prevent Catastrophic ForgettingTyler L. Hayes, Kushal Kafle, Robik Shrestha … Christopher KananECCV · Rochester Institute of Technology · Adobe Systems (United States) · +2
    PDF ↗
  19. 2020
    Continual Lifelong Learning in Natural Language Processing: A SurveyMagdalena Biesialska, Katarzyna Biesialska, Marta R. Costa-jussàCOLING · Universitat Politècnica de Catalunya
    PDF ↗
  20. 2020
    Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less ForgettingSanyuan Chen, Yutai Hou, Yiming Cui … Xiangzhan YuEMNLP · Harbin Institute of Technology · Joint Research Centre · +1
    PDF ↗
  21. 2020
    Adversarial Continual LearningSayna Ebrahimi, Franziska Meier, Roberto Calandra … Marcus RohrbachECCV · Berkeley College · Meta (United States) · +2
    PDF ↗
  22. 2020
    What Happens To BERT Embeddings During Fine-tuning?Amil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, Ian TenneyBlackboxNLP Workshop on Analyzing and Interpreting Neural… · Google (United States) · University of California, Santa Cruz · +1
    PDF ↗
  23. 2020
    Memory-Efficient Incremental Learning Through Feature AdaptationAhmet İşcen, Jeffrey Zhang, Svetlana Lazebnik, Cordelia SchmidECCV · University of Illinois Urbana-Champaign
    PDF ↗
  24. 2020
    Learning to Continually LearnBeaulieu Shawn, Frati Lapo, Miconi Thomas … Cheney NickFrontiers
    PDF ↗
  25. 2020
    Imbalanced Continual Learning with Partitioning Reservoir SamplingChris Dongjoo Kim, Jinseo Jeong, Gunhee KimECCV · Seoul National University
    PDF ↗
  26. 2020
    Continual Relation Learning via Episodic Memory Activation and ReconsolidationXu Han, Yi Dai, Tianyu Gao … Jie ZhouACL · Intelligent Systems Research (United States) · Intelligent Health (United Kingdom) · +3
    PDF ↗
  27. 2020
    More Classifiers, Less Forgetting: A Generic Multi-classifier Paradigm for Incremental LearningYu Liu, Sarah Parisot, Greg Slabaugh … Tinne TuytelaarsECCV · KU Leuven · Huawei Technologies (China) · +1
    PDF ↗
  28. 2020
    Continual Learning for Natural Language Generation in Task-oriented Dialog SystemsFei Mi, Liangwei Chen, Mengjie Zhao … Boi FaltingsEMNLP · École Polytechnique Fédérale de Lausanne · LMU Klinikum · +2
    PDF ↗
  29. 2020
    Efficient Meta Lifelong-Learning with Limited MemoryZirui Wang, Sanket Vaibhav Mehta, Barnabás Póczos, Jaime CarbonellEMNLP · Carnegie Mellon University
    PDF ↗
  30. 2020
    Reparameterizing Convolutions for Incremental Multi-Task Learning without Task InterferenceMenelaos Kanakis, David Brüggemann, Suman Saha … Luc Van GoolECCV · ETH Zurich · KU Leuven
    PDF ↗
  31. 2020PDF ↗
  32. 2020
    Online Continual Learning under Extreme Memory ConstraintsEnrico Fini, Stéphane Lathuilière, Enver Sangineto … Elisa RicciECCV · University of Trento · Télécom Paris · +2
    PDF ↗
  33. 2020
    Class-Incremental Domain AdaptationJogendra Nath Kundu, Rahul Venkatesh, Naveen Venkat … R. Venkatesh BabuECCV · Indian Institute of Science Bangalore
    PDF ↗
  34. 2020
    Disentangle-based Continual Graph Representation LearningXiaoyu Kou, Yankai Lin, Shaobo Liu … Yan ZhangEMNLP · Peking University · Tencent (China)
    PDF ↗
  35. 2020
    RODEO: Replay for Online Object DetectionManoj Acharya, Tyler L. Hayes, Christopher KananBMVC · Rochester Institute of Technology
    PDF ↗
  36. 2020
    A Two-phase Prototypical Network Model for Incremental Few-shot Relation ClassificationHaopeng Ren, Yi Cai, Xiaofeng Chen … Qing LiCOLING · Ministry of Natural Resources · South China University of Technology · +1
    PDF ↗
  37. 2020
    Continual Adaptation for Efficient Machine CommunicationRobert D. Hawkins, Minae Kwon, Dorsa Sadigh, Noah D. GoodmanCoNLL · Princeton University · Department of Physics, Mathematics and Informatics · +1
    PDF ↗
  38. 2020
    Online Continual Learning on SequencesGerman I. Parisi, Vincenzo LomonacoStudies in computational intelligence · Universität Hamburg · University of Bologna
    PDF ↗
  39. 2020
    Piggyback GAN: Efficient Lifelong Learning for Image Conditioned GenerationMengyao Zhai, Lei Chen, Jiawei He … Greg MoriECCV · Simon Fraser University · Collège Boréal
    PDF ↗
  40. 2020PDF ↗
  41. 2020PDF ↗
  42. 2020
    Initial Classifier Weights Replay for Memoryless Class Incremental LearningEden Belouadah, Adrian Popescu, Ioannis KanellosBMVC · Commissariat à l'Énergie Atomique et aux Énergies Alternatives
    PDF ↗
  43. 2020
    On the Exploration of Incremental Learning for Fine-grained Image RetrievalWei Chen, Yu Liu, Weiping Wang … Michael S. LewBMVC · Leiden University · KU Leuven · +1
    PDF ↗
  44. 2020
    Visually Grounded Continual Learning of Compositional PhrasesXisen Jin, Junyi Du, Arka Sadhu … Xiang RenEMNLP · University of Southern California · California Southern University · +1
    PDF ↗
  45. 2020
    An Empirical Investigation towards Efficient Multi-Domain Language Model Pre-trainingKristjan Arumae, Qing Sun, Parminder BhatiaEMNLP · Amazon (United States) · Seattle University · +1
    PDF ↗
  46. 2020
    Active Class Incremental Learning for Imbalanced DatasetsEden Belouadah, Adrian Popescu, Umang Aggarwal, Léo SaciSpringer LNCS · Commissariat à l'Énergie Atomique et aux Énergies Alternatives · Laboratoire d'Intégration des Systèmes et des Technologies · +1
    PDF ↗
  47. 2020
    Human Action Recognition and Assessment via Deep Neural Network Self-OrganizationGerman I. ParisiModelling Human Motion · Universität Hamburg
    PDF ↗
  48. 2020
    Using the Past Knowledge to Improve Sentiment ClassificationQi Qin, Wenpeng Hu, Bing LiuEMNLP · Peking University · King University
    PDF ↗
  49. 2020
    Continual Learning Long Short Term MemoryXin Guo, Yu Tian, Qinghan Xue … Xiaolong WangEMNLP · University of Delaware
    PDF ↗
  50. 2020
    Moving Towards Open Set Incremental Learning: Readily Discovering New AuthorsJustin Leo, Jugal KalitaAdvances in intelligent systems and computing · University of Colorado Colorado Springs
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It lists only papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or led by someone who has published there, or cited a few hundred times, and only papers with a PDF we can point you at, so every title opens the paper itself. Preprints that later get accepted, and authors who later publish at those venues, are picked up by the weekly run. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.