Back to Benchmarks

gemma-2-9b-it

text-generation

Uploaded: 03.07.2024

⏱️ Benchmarks

✨ Query this model

Region:

Hong Kong Belgium Iowa

Seq Length:

Providers

together-ai

deepinfra

groq

lepton-ai

Learn more about how we are collecting this data here

Output Tks / Sec

_{P90}

_{P90}

_{P90}

_{P90}

0.3 $/1M tks

0.3 $/1M tks

99.43 tks/sec

738.96 ms

10.06 ms

2217.43 ms

0 sec

0.06 $/1M tks

0.06 $/1M tks

57.15 tks/sec

482.38 ms

17.5 ms

3614.52 ms

0 sec

0.2 $/1M tks

0.2 $/1M tks

394.07 tks/sec

414.26 ms

2.54 ms

944.63 ms

0 sec

0.07 $/1M tks

0.07 $/1M tks

78.25 tks/sec

718.07 ms

12.78 ms

3312.26 ms

0 sec