Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

18 papers of 11,817Sort Recent · Most cited
  1. 2023
    Continual Learning: Forget-Free Winning Subnetworks for Video RepresentationsHaeyong Kang, Jaehong Yoon, Sung Ju Hwang, C. D. YooTPAMI
    PDF ↗
  2. 2023
    Carpe diem: On the Evaluation of World Knowledge in Lifelong Language ModelsYujin Kim, Jaehong Yoon, Seonghyeon Ye … Se-young YunNAACL
    PDF ↗
  3. 2023
    STELLA: Continual Audio-Video Pre-training with Spatio-Temporal Localized AlignmentJaewoo Lee, Jaehong Yoon, Wonjae Kim … Sung Ju HwangICML
    PDF ↗
  4. 2023
    Continual Learners are Incremental Model GeneralizersJaehong Yoon, Sung Ju Hwang, Yu CaoICML
    PDF ↗
  5. 2023
    Progressive Fourier Neural Representation for Sequential Video CompilationHaeyong Kang, Dahyun Kim, Jaehong Yoon … C. D. YooICLR
    PDF ↗
  6. 2023
    Forget-free Continual Learning with Soft-Winning SubNetworksHaeyong Kang, Jaehong Yoon, Sultan Rizky Hikmawan Madjid … C. D. YooarXiv
    PDF ↗
  7. 2022
    On the Soft-Subnetwork for Few-shot Class Incremental LearningHaeyong Kang, Jaehong Yoon, Sultan Rizky Hikmawan Madjid … Chang D. YooICLR
    PDF ↗
  8. 2022
    KALA: Knowledge-Augmented Language Model AdaptationMinki Kang, Jinheon Baek, Sung Ju HwangNAACL
    PDF ↗
  9. 2022
    Forget-free Continual Learning with Winning SubnetworksHaeyong Kang, R. Mina, Sultan Rizky Hikmawan Madjid … C. YooICML
  10. 2021
    Representational Continuity for Unsupervised Continual LearningDivyam Madaan, Jaehong Yoon, Yuanchun Li … Sung Ju HwangICLR
    PDF ↗
  11. 2021
    Sequential Reptile: Inter-Task Gradient Alignment for Multilingual LearningSeanie Lee, Haebeom Lee, Juho Lee, Sung Ju HwangarXiv · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  12. 2021
    Online Coreset Selection for Rehearsal-based Continual LearningJaehong Yoon, Divyam Madaan, Eunho Yang, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  13. 2021
    Rethinking the Representational Continuity: Towards Unsupervised Continual LearningDivyam Madaan, Jaehong Yoon, Yuanchun Li … Sung Ju HwangICLR
  14. 2020
    Federated Continual Learning with Weighted Inter-client TransferJaehong Yoon, Wonyong Jeong, Giwoong Lee … Sung Ju HwangICML · Korea Advanced Institute of Science and Technology · Korea Institute of Science and Technology
    PDF ↗
  15. 2020
    Federated Continual Learning with Adaptive Parameter CommunicationJaehong Yoon, Wonyong Jeong, Giwoong Lee … Sung Ju HwangarXiv
  16. 2019
    ORACLE: Order Robust Adaptive Continual LEarningJaehong Yoon, Saehoon Kim, Eunho Yang, Sung Ju HwangarXiv
  17. 2018PDF ↗
  18. 2017
    Lifelong Learning with Dynamically Expandable NetworksJaehong Yoon, Eunho Yang, Jeongtae Lee, Sung Ju HwangICLR · Korea Advanced Institute of Science and Technology
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.