Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

460 papers of 8,653 · showing 101–150Sort Recent · Most cited
  1. 2020
    Energy-Based Models for Continual LearningShuang Li, Yilun Du, Gido M. van de Ven, Igor MordatchCoLLAs · Massachusetts Institute of Technology
    PDF ↗
  2. 2020
    Lethean Attack: An Online Data Poisoning TechniqueEyal PerryarXiv · Massachusetts Institute of Technology
    PDF ↗
  3. 2020
    Consolidation via Policy Information Regularization in Deep RL for Multi-Agent GamesTyler Malloy, Tim Klinger, Miao Liu … Chris R. SimsarXiv
    PDF ↗
  4. 2020
    Motivational engine and long-term memory coupling within a cognitive architecture for lifelong open-ended learningJ. A. Becerra, Alejandro Romero, Francisco Bellas, Richard J. DuroNeurocomputing · Universidade da Coruña
  5. 2020
    Generalized Continual Zero-Shot LearningChandan Gautam, Sethupathy Parameswaran, Ashish Mishra, Suresh SundaramarXiv · Indian Institute of Science Bangalore · Indian Institute of Technology Madras
    PDF ↗
  6. 2020
    Brick Assembly Networks: An Effective Network for Incremental Learning ProblemsJiacang Ho, Dae-Ki KangElectronics · Dongseo University
  7. 2020PDF ↗
  8. 2020
    Comparative Analysis of Catastrophic Forgetting in Metric LearningJiahao Huo, Terence L. van ZylInternational Conference on Soft Computing & Machine… · University of the Witwatersrand · University of Johannesburg
  9. 2020
    Continual Learning with Deep Artificial NeuronsBlake Camp, Jaya Krishna Mandivarapu, Rolando EstradaarXiv · Georgia State University
    PDF ↗
  10. 2020
    Lifelong learning of interpretable image representationsFei Ye, Adrian G. BorşICIP · University of York
  11. 2020
    State Primitive Learning to Overcome Catastrophic Forgetting in RoboticsFangzhou Xiong, Zhiyong Liu, Kaizhu Huang … Hong QiaoCognitive Computation · Shandong Institute of Automation · University of Chinese Academy of Sciences · +2
  12. 2020
    A Novel Layer Sharing-based Incremental Learning via Bayesian OptimizationYoonsik Choe, Bomi Kim, Taehyeon KimApplied Sciences · Yonsei University
  13. 2020
    Class incremental learning via Multi-hinge distillationQianhe Lin, Yuanlong Yu, Zhiyong HuangChinese Automation Congress (CAC) · Fuzhou University · Zhejiang Lab
  14. 2020PDF ↗
  15. 2020
    Embracing Change: Continual Learning in Deep Neural Networks.Raia Hadsell, Dushyant Rao, Andrei A. Rusu, Razvan PascanuTrends in Cognitive Sciences · Google DeepMind (United Kingdom) · Google (United Kingdom)
  16. 2020
    One-Shot Neural Architecture Search: Maximising Diversity to Overcome Catastrophic ForgettingMiao Zhang, Huiqi Li, Shirui Pan … Steven W. SuTPAMI · Beijing Institute of Technology · Monash University · +2
  17. 2020
    Meta-Learning for Natural Language Understanding under Continual Learning FrameworkJiacheng Wang, Yong Fan, Duo Jiang, Shiqing LiarXiv · Supélec · University of Applied Sciences and Arts of Southern Switzerland · +1
    PDF ↗
  18. 2020
    Learn-Prune-Share for Lifelong LearningZifeng Wang, Tong Jian, Kaushik Chowdhury … Stratis IoannidisICDM · Northeastern University
    PDF ↗
  19. 2020
    CLIFER: Continual Learning with Imagination for Facial Expression RecognitionNikhil Churamani, Hatice GüneşIEEE International Conference on Automatic Face and Gestu… · University of Cambridge
  20. 2020
    Lifelong Learning Without a Task OracleAmanda Rios, Laurent IttiIEEE 32nd International Conference on Tools with Artifici… · University of Southern California
    PDF ↗
  21. 2020
    An Error-Correcting Output Code Framework for Lifelong Learning without a TeacherShen-Shyang Ho, Mathew Marchiano, Scott Zockoll, Hiêú D. NguyêñIEEE 32nd International Conference on Tools with Artifici… · Rowan University
  22. 2020
    SEM: Adaptive Staged Experience Access Mechanism for Reinforcement LearningJianshu Wang, Xinzhi Wang, Xiangfeng Luo … Yang LiIEEE 32nd International Conference on Tools with Artifici… · Shanghai University of Engineering Science
  23. 2020
  24. 2020
    Neural inhibition for continual learning and memoryHelen C. BarronCurrent Opinion in Neurobiology · John Radcliffe Hospital · University of Oxford · +3
  25. 2020
    A Study on Efficiency in Continual Learning Inspired by Human LearningPhilip Ball, Yingzhen Li, Angus Lamb, Cheng ZhangarXiv
    PDF ↗
  26. 2020
    Continual Learning in Automatic Speech RecognitionSamik Sadhu, Hynek HeřmanskýInterspeech
  27. 2020
    Continual Learning for Multi-Dialect Acoustic ModelsB. Houston, Katrin KirchhoffInterspeech
  28. 2020
    SERIL: Noise Adaptive Speech Enhancement using Regularization-based Incremental LearningChi-Chang Lee, Yu-Chen Lin, Hsuan-Tien Lin … Yu TsaoInterspeech
    PDF ↗
  29. 2020
    Tell me what this is: Few-Shot Incremental Object Learning by a RobotAli Ayub, Alan R. WagnerIROS · Pennsylvania State University
    PDF ↗
  30. 2020
    A Combinatorial Perspective on Transfer LearningJianan Wang, Eren Sezener, David Budden … Joel VenessNeurIPS · Google (United States)
    PDF ↗
  31. 2020
    Continual Learning in Low-rank Orthogonal SubspacesArslan Chaudhry, Naeemullah Khan, Puneet K. Dokania, Philip H. S. TorrNeurIPS · University of Oxford
    PDF ↗
  32. 2020
    An Appraisal of Incremental Learning MethodsYong Luo, Liancheng Yin, Wen-Chao Bai, Keming MaoEntropy · Northeastern University
  33. 2020
  34. 2020
    An integrated classification model for incremental learningJi Hu, Chenggang Yan, Xin Liu … Yi YangMultimedia Tools and Applications · Hangzhou Dianzi University · University of Technology Sydney
  35. 2020
    The Present and Future of Continual LearningHeechul Bae, Soonyong Song, Junhee ParkInternational Conference on Information and Communication… · Electronics and Telecommunications Research Institute
  36. 2020
    Streaming Graph Neural Networks via Continual LearningJunshan Wang, Guojie Song, Yi Wu, Liang WangCIKM · Peking University · Alibaba Group (China)
    PDF ↗
  37. 2020
    GraphSAIL: Graph Structure Aware Incremental Learning for Recommender SystemsYishi Xu, Yingxue Zhang, Wei Guo … Mark CoatesCIKM · Université de Montréal · Huawei Technologies (Canada) · +2
    PDF ↗
  38. 2020
    Continual Domain Adaptation for Machine Reading ComprehensionLixin Su, Jiafeng Guo, Ruqing Zhang … Xueqi ChengCIKM · Computer Network Information Center · University of Chinese Academy of Sciences
    PDF ↗
  39. 2020
    Continual Unsupervised Domain Adaptation for Semantic SegmentationJoonhyuk Kim, Sahng-Min Yoo, Gyeong-Moon Park, Jong-Hwan KimarXiv
    PDF ↗
  40. 2020
    Continual Learning for Neural Semantic ParsingVladislav Lialin, Rahul Goel, Andrey Simanovsky … Rushin ShaharXiv · University of Massachusetts Lowell · Google (United States)
    PDF ↗
  41. 2020
    IExpressNet: Facial Expression Recognition with Incremental ClassesJunjie Zhu, Bingjun Luo, Sicheng Zhao … Yue GaoACM International Conference on Multimedia · Tsinghua University · University of California, Berkeley · +1
  42. 2020
    Transfer of Inter-Robotic Inductive ClassifierRudolf Szadkowski, Miloš Prágr, Jan FaiglInternational Conference on Automation, Control and Robot… · Czech Technical University in Prague
  43. 2020
    Mitigating Catastrophic Forgetting In Adaptive Class Incremental Extreme Learning Machine Through Neuron ClusteringGhalib Ahmed Tahir, Chu Kiong LooIEEE International Conference on Systems, Man, and Cybern… · University of Malaya
  44. 2020
    Prototype-Based Discriminative Feature Representation for Class-incremental Cross-modal RetrievalShaoquan Zhu, Yong Feng, Mingliang Zhou … Ran WeiInternational Journal of Pattern Recognition and Artifici… · Ministry of Education of the People's Republic of China · Chongqing University · +3
  45. 2020
    Linear Mode Connectivity in Multitask and Continual LearningSeyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Görür … Hassan GhasemzadehICLR · Washington State University · Google (United States)
    PDF ↗
  46. 2020PDF ↗
  47. 2020
    A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap MatrixThang Doan, Mehdi Bennani, Bogdan Mazoure … Pierre AlquierAISTATS
    PDF ↗
  48. 2020
    The Effectiveness of Memory Replay in Large Scale Continual LearningYogesh Balaji, Mehrdad Farajtabar, Dong Yin … Ang LiarXiv
    PDF ↗
  49. 2020
    Continual Learning with Sparse Progressive Neural NetworksEsra Ergün, Behçet Uğur TöreyınSignal Processing and Communications Applications Confere…
  50. 2020
    Remembering for the Right Reasons: Explanations Reduce Catastrophic ForgettingSayna Ebrahimi, S. Petryk, Akash Gokul … Trevor DarrellICLR
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.