Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

14 papers of 11,817Sort Recent · Most cited
  1. 2024
    Continual Reinforcement Learning for Controlled Text GenerationVelizar Shulev, Khalil Sima'anInternational Conference on Language Resources and Evalua…
  2. 2024
    Distilling Causal Effect of Data in Continual Few-shot Relation LearningWei-Hang Ye, Peng Zhang, Jing Zhang … Moyao WangInternational Conference on Language Resources and Evalua…
  3. 2024
    Enhancing Translation Ability of Large Language Models by Leveraging Task-Related LayersPei Cheng, Xia-Yang Shi, Yinlin LiInternational Conference on Language Resources and Evalua…
  4. 2024
    Improving Continual Few-shot Relation Extraction through Relational Knowledge Distillation and Prototype AugmentationZhiheng Zhang, Daojian Zeng, Xu BaiInternational Conference on Language Resources and Evalua…
  5. 2024
    Towards Autonomous Tool Utilization in Language Models: A Unified, Efficient and Scalable FrameworkZhi Li, Yicheng Li, He Ye, Yin ZhangInternational Conference on Language Resources and Evalua…
  6. 2024
    MoNMT: Modularly Leveraging Monolingual and Bilingual Knowledge for Neural Machine TranslationJianhui Pang, Baosong Yang, Derek F. Wong … Lidia S. ChaoInternational Conference on Language Resources and Evalua…
  7. 2024
    Depth Aware Hierarchical Replay Continual Learning for Knowledge Based Question AnsweringZhixiong Cao, Hai-Tao Zheng, Yangning Li … Hong-Gee KimInternational Conference on Language Resources and Evalua…
  8. 2024
    Structure-aware Generation Model for Cross-Domain Aspect-based Sentiment ClassificationShichen Li, Zhongqing Wang, Yanzhi Xu, Guodong ZhouInternational Conference on Language Resources and Evalua…
  9. 2024
    STAF: Pushing the Boundaries of Test-Time Adaptation towards Practical Noise ScenariosHaoyu Xiong, Xinchun Zhang, Leixin Yang … Gang FangInternational Conference on Language Resources and Evalua…
  10. 2024
    Class-Incremental Few-Shot Event DetectionKailin Zhao, Xiaolong Jin, Long Bai … Xueqi ChengInternational Conference on Language Resources and Evalua…
    PDF ↗
  11. 2024
    Mixture-of-LoRAs: An Efficient Multitask Tuning Method for Large Language ModelsWenfeng Feng, Chuzhan Hao, Yuewei Zhang … Hao WangInternational Conference on Language Resources and Evalua…
    PDF ↗
  12. 2024
    DP-CRE: Continual Relation Extraction via Decoupled Contrastive Learning and Memory Structure PreservationMengyi Huang, Meng Xiao, Ludi Wang, Yi DuInternational Conference on Language Resources and Evalua…
    PDF ↗
  13. 2024
    Making Pre-trained Language Models Better Continual Few-Shot Relation ExtractorsShengkun Ma, Jiale Han, Yi Liang, Bo ChengInternational Conference on Language Resources and Evalua…
    PDF ↗
  14. 2024
    MemoryPrompt: A Light Wrapper to Improve Context Tracking in Pre-trained Language ModelsNathanaël Carraz Rakotonirina, Marco BaroniInternational Conference on Language Resources and Evalua…
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.