ICML · 2023 · Conference paper

Exploring the Benefits of Training Expert Language Models over Instruction Tuning

Joel Jang, Seungone Kim, Seonghyeon Ye, Doyoung Kim, Lajanugen Logeswaran, Moontae Lee, Kyungjae Lee, Minjoon Seo

PDF from arXiv.HTML · PDF · Open in a new tab ↗ · Close
Published in
International Conference on Machine Learning
Date
2023-02-07
Citations
100
arXiv
2302.03202
Cite
@inproceedings{jang2023exploring,
  title = {Exploring the Benefits of Training Expert Language Models over Instruction Tuning},
  author = {Joel Jang and Seungone Kim and Seonghyeon Ye and Doyoung Kim and Lajanugen Logeswaran and Moontae Lee and Kyungjae Lee and Minjoon Seo},
  year = {2023},
  booktitle = {International Conference on Machine Learning},
  eprint = {2302.03202},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2302.03202},
}