EMNLP · 2025 · Conference paper

Mitigating Visual Knowledge Forgetting in MLLM Instruction-tuning via Modality-decoupled Gradient Descent

Junda Wu, Yuxin Xiong, Xintong Li, Yu Xia, Ruoyu Wang, Yu Wang, Tong Yu, Sungchul Kim, Ryan A. Rossi, Lina Yao, Jingbo Shang, Julian J. McAuley

PDF from arXiv.HTML · PDF · Open in a new tab ↗ · Close
Published in
Conference on Empirical Methods in Natural Language Processing
Date
2025-02-17
Citations
15
arXiv
2502.11740
Cite
@inproceedings{wu2025mitigating,
  title = {Mitigating Visual Knowledge Forgetting in MLLM Instruction-tuning via Modality-decoupled Gradient Descent},
  author = {Junda Wu and Yuxin Xiong and Xintong Li and Yu Xia and Ruoyu Wang and Yu Wang and Tong Yu and Sungchul Kim and Ryan A. Rossi and Lina Yao and Jingbo Shang and Julian J. McAuley},
  year = {2025},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  eprint = {2502.11740},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2502.11740},
}