Back to Benchmarks

qwen-2-72b-instruct

text-generation

Uploaded: 02.07.2024

⏱️ Benchmarks

✨ Query this model

Region:

Hong Kong Belgium Iowa

Seq Length:

Providers

lepton-ai

together-ai

Learn more about how we are collecting this data here

Output Tks / Sec

_{P90}

_{P90}

_{P90}

_{P90}

0.8 $/1M tks

0.8 $/1M tks

39.47 tks/sec

571.04 ms

25.34 ms

5030.06 ms

0 sec

0.9 $/1M tks

0.9 $/1M tks

63.49 tks/sec

447.18 ms

15.75 ms

3108.97 ms

0 sec