Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

19 papers of 8,653Sort Recent · Most cited
  1. 2026
    G2LoRA: Gradient Orthogonal Low-Rank Adaptation Framework for Graph Continual Learning on Text-Attributed GraphsYuhan Wang, Yibo Ding, Yutong Ye … Jianxin LiKDD · Beihang University · Columbia University · +1
    PDF ↗
  2. 2026
    Order parameters and phase transitions of continual learning in deep neural networksHaozhe Shan, Qianyi Li, Haim SompolinskyPNAS · Harvard University · Harvard University Press · +4
    PDF ↗
  3. 2023
    DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio CodesXilin Jiang, Yinghao Aaron Li, Nima MesgaraniInterspeech · Columbia University
    PDF ↗
  4. 2023
    MetaMix: Towards Corruption-Robust Continual Learning with Temporally Self-Adaptive Data TransformationZhenyi Wang, Li Shen, Donglin Zhan … Mingchen GaoCVPR · University at Buffalo, State University of New York · Jingdong (China) · +1
  5. 2023
    The computational and neural bases of context-dependent learningJames B. Heald, Daniel M. Wolpert, Máté LengyelAnnual Review of Neuroscience · Columbia University · University of Cambridge
    PDF ↗
  6. 2022
    Memory Bounds for Continual LearningXi Chen, Christos H. Papadimitriou, Binghui PengIEEE 63rd Annual Symposium on Foundations of Computer Sci… · Columbia University
    PDF ↗
  7. 2022
    Learning to Learn and Remember Super Long Multi-Domain Task SequenceZhenyi Wang, Li Shen, Tiehang Duan … Mingchen GaoCVPR · University at Buffalo, State University of New York · Jingdong (China) · +1
  8. 2022
    Biological underpinnings for lifelong learning machinesDhireesha Kudithipudi, Mario Aguilar-Simon, Jonathan Babb … Hava T. SiegelmannNature Machine Intelligence · The University of Texas at San Antonio · Intelligent Systems Research (United States) · +24
    PDF ↗
  9. 2022
    Fine-tuned Language Models are Continual LearnersThomas Scialom, Tuhin Chakrabarty, Smaranda MuresanEMNLP · University of Missouri · Columbia University
    PDF ↗
  10. 2022
    Learning Representations for New Sound Classes With Continual Self-Supervised LearningZhepei Wang, Cem Subakan, Xilin Jiang … Paris SmaragdisIEEE Signal Processing Letters · University of Illinois Urbana-Champaign · Concordia University · +2
    PDF ↗
  11. 2021
    Meta-learning synaptic plasticity and memory addressing for continual familiarity detectionDanil Tyulmankov, Guangyu Robert Yang, L. F. AbbottNeuron · Columbia University · Allen Institute for Brain Science · +1
  12. 2021
    Meta-learning local synaptic plasticity for continual familiarity detectionDanil Tyulmankov, Guangyu Robert Yang, L. F. AbbottbioRxiv · Columbia University
  13. 2021
    Continual Learning in Task-Oriented Dialogue SystemsAndrea Madotto, Zhaojiang Lin, Zhenpeng Zhou … Zhiguang WangEMNLP · Hong Kong University of Science and Technology · Meta (Israel) · +1
    PDF ↗
  14. 2020
    Learning to Learn with Feedback and Local PlasticityJack Lindsey, Ashok Litwin-KumarNeurIPS · Columbia University
    PDF ↗
  15. 2020
    Model primitives for hierarchical lifelong reinforcement learningBohan Wu, Jayesh K. Gupta, Mykel J. KochenderferAutonomous Agents and Multi-Agent Systems · Columbia University · Stanford University
  16. 2019
    Continual Learning in a Multi-Layer Network of an Electric FishSalomon Z. Muller, Abigail N Zadina, L. F. Abbott, Nathaniel B. SawtellCell · Columbia University
  17. 2019
    Model Primitive Hierarchical Lifelong Reinforcement LearningBohan Wu, Jayesh K. Gupta, Mykel J. KochenderferInternational Joint Conference on Autonomous Agents and M… · Columbia University · Stanford University
    PDF ↗
  18. 2019
    Task representations in neural networks trained to perform many cognitive tasksGuangyu Robert Yang, Madhura R. Joglekar, Hui Song … Xiao‐Jing WangNature Neuroscience · New York University · Columbia University · +5
  19. 2019
    A Progressive Model to Enable Continual Learning for Semantic Slot FillingYilin Shen, Xiangyu Zeng, Hongxia JinEMNLP · Samsung (South Korea) · Samsung (United States) · +1
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.