arXiv · 2024 · Preprint

Domain Adaptation of Llama3-70B-Instruct through Continual Pre-Training and Model Merging: A Comprehensive Evaluation

S. Siriwardhana, Mark McQuade, T. Gauthier, Lucas Atkins, Fernando Fernandes, Luke Meyers, Anneketh Vij, Tyler Odenthal, Charles Goddard, M. Maccarthy, Jacob Solawetz

Date
2024-06-21
Citations
20
arXiv
2406.14971
Cite
@misc{siriwardhana2024domain,
  title = {Domain Adaptation of Llama3-70B-Instruct through Continual Pre-Training and Model Merging: A Comprehensive Evaluation},
  author = {S. Siriwardhana and Mark McQuade and T. Gauthier and Lucas Atkins and Fernando Fernandes and Luke Meyers and Anneketh Vij and Tyler Odenthal and Charles Goddard and M. Maccarthy and Jacob Solawetz},
  year = {2024},
  eprint = {2406.14971},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2406.14971},
}