AAAI · 2024 · Conference paper

MoE-LPR: Multilingual Extension of Large Language Models through Mixture-of-Experts with Language Priors Routing

Hao Zhou, Zhijun Wang, Shujian Huang, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Weihua Luo, Jiajun Chen

Published in
AAAI Conference on Artificial Intelligence
Date
2024-08-21
Citations
24
arXiv
2408.11396
Cite
@inproceedings{zhou2024moelpr,
  title = {MoE-LPR: Multilingual Extension of Large Language Models through Mixture-of-Experts with Language Priors Routing},
  author = {Hao Zhou and Zhijun Wang and Shujian Huang and Xin Huang and Xue Han and Junlan Feng and Chao Deng and Weihua Luo and Jiajun Chen},
  year = {2024},
  booktitle = {AAAI Conference on Artificial Intelligence},
  eprint = {2408.11396},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2408.11396},
}