Back to Benchmarks

mistral-nemo

text-generation
Uploaded: 24.07.2024
⏱️ Benchmarks
✨ Query this model
Region:
Hong KongBelgiumIowa
Seq Length:
ShortLong
Providers
provider icon
vertex-ai
provider icon
lepton-ai
provider icon
azure-ai
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
mistral-ai
Learn more about how we are collecting this data here
Input Cost
Output Cost
Output Tks / SecP90_{P90}
TTFTP90_{P90}
ITLP90_{P90}
E2E LatencyP90_{P90}
Cold Start
0.15 $/1M tks
0.15 $/1M tks
200.31 tks/sec
483.52 ms
4.99 ms
4472.38 ms
0 sec
0.18 $/1M tks
0.18 $/1M tks
62.07 tks/sec
641.31 ms
16.11 ms
1350.18 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.15 $/1M tks
0.15 $/1M tks
134.9 tks/sec
432.43 ms
7.41 ms
551.04 ms
0 sec