Back to Benchmarks

gemma-2-9b-it

text-generation

Uploaded: 03.07.2024

⏱️ Benchmarks

✨ Query this model

Region:

Hong Kong Belgium Iowa

Seq Length:

Providers

together-ai

deepinfra

groq

lepton-ai

Learn more about how we are collecting this data here

Output Tks / Sec

_{P90}

_{P90}

_{P90}

_{P90}

0.3 $/1M tks

0.3 $/1M tks

101.08 tks/sec

1020.4 ms

9.89 ms

11022 ms

0 sec

0.06 $/1M tks

0.06 $/1M tks

58.49 tks/sec

696.24 ms

17.1 ms

18444.23 ms

0 sec

0.2 $/1M tks

0.2 $/1M tks

358.49 tks/sec

634.3 ms

2.79 ms

2447.47 ms

0 sec

0.07 $/1M tks

0.07 $/1M tks

79.81 tks/sec

1001.19 ms

12.53 ms

3018.37 ms

0 sec