ICASSP · 2024 · Conference paper

HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models

Bingshen Mu, Kun Wei, Qijie Shao, Yong Xu, Lei Xie

Northwestern Polytechnical University · Tencent (China)

PDF from arXiv.HTML · PDF · Open in a new tab ↗ · Close
Published in
ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Date
2025-03-12
Citations
22
arXiv
2409.19878
Cite
@inproceedings{mu2024hdmole,
  title = {HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models},
  author = {Bingshen Mu and Kun Wei and Qijie Shao and Yong Xu and Lei Xie},
  year = {2024},
  booktitle = {ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  eprint = {2409.19878},
  archivePrefix = {arXiv},
  doi = {10.1109/ICASSP49660.2025.10888133},
  url = {https://arxiv.org/abs/2409.19878},
}