Back to Benchmarks

gemma-2-9b-it

text-generation
Uploaded: 03.07.2024
⏱️ Benchmarks
✨ Query this model
Region:
Hong KongBelgiumIowa
Seq Length:
ShortLong
Providers
provider icon
together-ai
provider icon
deepinfra
provider icon
groq
provider icon
lepton-ai
Learn more about how we are collecting this data here
Input Cost
Output Cost
Output Tks / SecP90_{P90}
TTFTP90_{P90}
ITLP90_{P90}
E2E LatencyP90_{P90}
Cold Start
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.06 $/1M tks
0.06 $/1M tks
58.64 tks/sec
545.57 ms
17.05 ms
16132.24 ms
0 sec
0.2 $/1M tks
0.2 $/1M tks
357.18 tks/sec
469.28 ms
2.8 ms
3333.4 ms
0 sec
0.07 $/1M tks
0.07 $/1M tks
68.03 tks/sec
791.06 ms
14.7 ms
1099.77 ms
0 sec