Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

301 papers of 8,653 · showing 201–250Sort Recent · Most cited
  1. 2020
    Generative Continual Concept LearningMohammad Rostami, Soheil Kolouri, Praveen K. Pilly, James L. McClellandAAAI · California University of Pennsylvania · HRL Laboratories (United States) · +1
    PDF ↗
  2. 2020
    DeGAN : Data-Enriching GAN for Retrieving Representative Samples from a Trained ClassifierSravanti Addepalli, Gaurav Kumar Nayak, Anirban Chakraborty, Venkatesh Babu RadhakrishnanAAAI · Indian Institute of Science Bangalore
    PDF ↗
  3. 2020
    Lifelong Learning with a Changing Action SetYash Chandak, Georgios Theocharous, Chris Nota, Philip S. ThomasAAAI · University of Massachusetts Amherst · Adobe Systems (United States)
    PDF ↗
  4. 2020
    Incremental multi-domain learning with network latent tensor factorizationAdrian Bulat, Jean Kossaifi, Georgios Tzimiropoulos, Maja PantićAAAI · Samsung (United States)
    PDF ↗
  5. 2020
    Bi-Objective Continual Learning: Learning 'New' While Consolidating 'Known'Xiaoyu Tao, Xiaopeng Hong, Xinyuan Chang, Yihong GongAAAI · Xi'an Jiaotong University
  6. 2020
    Learning from the Past: Continual Meta-Learning with Bayesian Graph Neural NetworksYadan Luo, Zi Huang, Zheng Zhang … Yang YangAAAI · The University of Queensland · Harbin Institute of Technology · +1
    PDF ↗
  7. 2020
    Residual Continual LearningJanghyeon Lee, Donggyu Joo, Hyeong Gwon Hong, Junmo KimAAAI · Korea Advanced Institute of Science and Technology · Kootenay Association for Science & Technology
    PDF ↗
  8. 2020
    Biologically Inspired Sleep Algorithm for Reducing Catastrophic Forgetting in Neural NetworksTimothy Tadros, Giri P. Krishnan, Ramyaa Ramyaa, Maxim BazhenovAAAI · University of California San Diego · New Mexico Institute of Mining and Technology
  9. 2020
  10. 2020
    Towards Lifelong Self-Supervision For Unpaired Image-to-Image TranslationVictor Schmidt, Makesh Narsimhan Sreedhar, Mostafa ElAraby, Irina RisharXiv
    PDF ↗
  11. 2020
    Continual Learning with Node-Importance based Adaptive Group Sparse RegularizationSangwon Jung, Hongjoon Ahn, Sungmin Cha, Taesup MoonNeurIPS · Sungkyunkwan University
    PDF ↗
  12. 2020
    Continual Graph LearningFan Zhou, Chengtai CaoarXiv
    PDF ↗
  13. 2020
    Relational Neurogenesis for Lifelong Learning AgentsTej Pandit, Dhireesha KudithipudiNeuro-inspired Computational Elements Workshop · The University of Texas at San Antonio
  14. 2020
    Rapid online learning and robust recall in a neuromorphic olfactory circuitNabil Imam, Thomas A. ClelandNature Machine Intelligence · Intel (United States) · Cornell University
    PDF ↗
  15. 2020
    Evaluating Logical Generalization in Graph Neural NetworksKoustuv Sinha, Shagun Sodhani, Joëlle Pineau, William L. HamiltonarXiv · McGill University
    PDF ↗
  16. 2020
    Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual LearningM. Caccia, Pau Rodríguez, Оleksiy Ostapenko … Laurent CharlinNeurIPS
    PDF ↗
  17. 2020
    A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortexBen Tsuda, Kay M. Tye, Hava T. Siegelmann, Terrence J. SejnowskiPNAS · Salk Institute for Biological Studies · University of California San Diego · +1
  18. 2020
    Prevention of catastrophic interference and imposing active forgetting with generative methodsSergey Sukhov, Mikhail Leontev, Alexander Miheev, Kirill SviatovNeurocomputing · Kotelnikov Institute of Radioengineering and Electronics of the Russian Academy of Sciences · Ulyanovsk State University · +1
  19. 2020
    Class-incremental Learning via Deep Model ConsolidationJunting Zhang, Jie Zhang, Shalini Ghosh … C.‐C. Jay KuoWACV · University of Southern California · California Southern University · +3
    PDF ↗
  20. 2020
    Online Fast Adaptation and Knowledge Accumulation (OSAKA): a New Approach to Continual LearningMassimo Caccia, Pau Rodríguez López, Oleksiy Ostapenko … Laurent CharlinNeurIPS
  21. 2020
    Regularize, Expand and Compress: NonExpansive Continual LearningJie Zhang, Junting Zhang, Shalini Ghosh … Yalin WangWACV · University of Southern California · Arizona State University · +1
  22. 2020
    On Catastrophic Interference in Atari 2600 GamesWilliam Fedus, Dibya Ghosh, John D. Martin … Hugo LarochellearXiv
    PDF ↗
  23. 2020
    Model primitives for hierarchical lifelong reinforcement learningBohan Wu, Jayesh K. Gupta, Mykel J. KochenderferAutonomous Agents and Multi-Agent Systems · Columbia University · Stanford University
  24. 2020
    BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong LearningYeming Wen, Dustin Tran, Jimmy BaICLR · University of Toronto · Google (United States)
    PDF ↗
  25. 2020
    A general fine-tune method for catastrophic forgettingTao Yang, Mingming Zhu, Hao Li, Yuan CaoMIPPR 2019: Automatic Target Recognition and Navigation · Wuhan Polytechnic University
  26. 2020
    Continual Universal Object DetectionXialei Liu, Hao Yang, Avinash Ravichandran … Stefano SoattoarXiv · Universitat Autònoma de Barcelona · Amazon (Germany)
    PDF ↗
  27. 2020
    Multimodal Continual Learning Using Online Dictionary UpdatingFuchun Sun, Huaping Liu, Chao Yang, Bin FangIEEE TCDS · Foshan University · Tsinghua University
  28. 2020
    Incremental Meta-Learning via Indirect Discriminant AlignmentQing Liu, Orchid Majumder, Alessandro Achille … Stefano SoattoECCV · Johns Hopkins University · Amazon (Germany)
    PDF ↗
  29. 2020
    A Novel Incremental Cross-Modal Hashing ApproachDevraj Mandal, Soma BiswasarXiv · Indian Institute of Science Bangalore
    PDF ↗
  30. 2020PDF ↗
  31. 2020
    Multiclass Oblique Random Forests With Dual-Incremental Learning CapacityZheng Chai, Chunhui ZhaoTNNLS · State Key Laboratory of Industrial Control Technology
  32. 2020
    Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed RepresentationsAlexander G. Ororbia, Ankur Mali, C. Lee Giles, Daniel KiferTNNLS · Rochester Institute of Technology · Pennsylvania State University
    PDF ↗
  33. 2020
    Active and Incremental Learning with Weak SupervisionClemens-Alexander Brust, Christoph Käding, Joachim DenzlerKünstliche Intell. · Friedrich Schiller University Jena
    PDF ↗
  34. 2020
    The hippocampal formation as a hierarchical generative model supporting generative replay and continual learningIvilin Peev Stoianov, Domenico Maisto, Giovanni PezzulobioRxiv · National Research Council · Institute of Cognitive Sciences and Technologies
  35. 2020
    Learn#: A Novel incremental learning method for text classificationGuangxu Shan, Shiyao Xu, Yang Li … Yang XiangExpert Systems with Applications · Tongji University
  36. 2020
    Dissecting Catastrophic Forgetting in Continual Learning by Deep VisualizationGiang Nguyen, Chen Shuan, Thao Do … Daeyoung KimarXiv
    PDF ↗
  37. 2020
    A Neural Dirichlet Process Mixture Model for Task-Free Continual LearningSoochan Lee, Junsoo Ha, Dongsu Zhang, Gunhee KimICLR
    PDF ↗
  38. 2020
    GDumb: A Simple Approach that Questions Our Progress in Continual LearningAmeya Prabhu, Philip H. S. Torr, Puneet K. DokaniaECCV · University of Oxford
  39. 2020
    REMIND Your Neural Network to Prevent Catastrophic ForgettingTyler L. Hayes, Kushal Kafle, Robik Shrestha … Christopher KananECCV · Rochester Institute of Technology · Adobe Systems (United States) · +2
    PDF ↗
  40. 2020
    Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less ForgettingSanyuan Chen, Yutai Hou, Yiming Cui … Xiangzhan YuEMNLP · Harbin Institute of Technology · Joint Research Centre · +1
    PDF ↗
  41. 2020
    Adversarial Continual LearningSayna Ebrahimi, Franziska Meier, Roberto Calandra … Marcus RohrbachECCV · Berkeley College · Meta (United States) · +2
    PDF ↗
  42. 2020
    What Happens To BERT Embeddings During Fine-tuning?Amil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, Ian TenneyBlackboxNLP Workshop on Analyzing and Interpreting Neural… · Google (United States) · University of California, Santa Cruz · +1
    PDF ↗
  43. 2020
    Memory-Efficient Incremental Learning Through Feature AdaptationAhmet İşcen, Jeffrey Zhang, Svetlana Lazebnik, Cordelia SchmidECCV · University of Illinois Urbana-Champaign
    PDF ↗
  44. 2020
    Topology-Preserving Class-Incremental LearningXiaoyu Tao, Xinyuan Chang, Xiaopeng Hong … Yihong GongECCV · Xi'an Jiaotong University · Peng Cheng Laboratory
  45. 2020
    Learning to Continually LearnBeaulieu Shawn, Frati Lapo, Miconi Thomas … Cheney NickFrontiers
    PDF ↗
  46. 2020
    Imbalanced Continual Learning with Partitioning Reservoir SamplingChris Dongjoo Kim, Jinseo Jeong, Gunhee KimECCV · Seoul National University
    PDF ↗
  47. 2020
    Continual Relation Learning via Episodic Memory Activation and ReconsolidationXu Han, Yi Dai, Tianyu Gao … Jie ZhouACL · Intelligent Systems Research (United States) · Intelligent Health (United Kingdom) · +3
  48. 2020
    More Classifiers, Less Forgetting: A Generic Multi-classifier Paradigm for Incremental LearningYu Liu, Sarah Parisot, Greg Slabaugh … Tinne TuytelaarsECCV · KU Leuven · Huawei Technologies (China) · +1
    PDF ↗
  49. 2020
    Continual Learning for Natural Language Generation in Task-oriented Dialog SystemsFei Mi, Liangwei Chen, Mengjie Zhao … Boi FaltingsEMNLP · École Polytechnique Fédérale de Lausanne · LMU Klinikum · +2
    PDF ↗
  50. 2020
    Efficient Meta Lifelong-Learning with Limited MemoryZirui Wang, Sanket Vaibhav Mehta, Barnabás Póczos, Jaime CarbonellEMNLP · Carnegie Mellon University
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.