arXiv · 2024 · Preprint

Domain Adaptation of Llama3-70B-Instruct through Continual Pre-Training and Model Merging: A Comprehensive Evaluation

Shamane Siriwardhana, Mark McQuade, Thomas Gauthier, Lucas Atkins, Fernando Fernandes Neto, Luke Meyers, Anneketh Vij, Tyler Odenthal, Charles Goddard, Mary MacCarthy, Jacob Solawetz

PDF from arXiv.HTML · PDF · Open in a new tab ↗ · Close
Date
2024-06-21
Citations
20
arXiv
2406.14971
Cite
@misc{siriwardhana2024domain,
  title = {Domain Adaptation of Llama3-70B-Instruct through Continual Pre-Training and Model Merging: A Comprehensive Evaluation},
  author = {Shamane Siriwardhana and Mark McQuade and Thomas Gauthier and Lucas Atkins and Fernando Fernandes Neto and Luke Meyers and Anneketh Vij and Tyler Odenthal and Charles Goddard and Mary MacCarthy and Jacob Solawetz},
  year = {2024},
  eprint = {2406.14971},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2406.14971},
}