Back to Benchmarks

mistral-nemo

text-generation
Uploaded: 24.07.2024
⏱️ Benchmarks
✨ Query this model
Region:
Hong KongBelgiumIowa
Seq Length:
ShortLong
Providers
provider icon
vertex-ai
provider icon
lepton-ai
provider icon
azure-ai
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
mistral-ai
Learn more about how we are collecting this data here
Input Cost
Output Cost
Output Tks / SecP90_{P90}
TTFTP90_{P90}
ITLP90_{P90}
E2E LatencyP90_{P90}
Cold Start
0.15 $/1M tks
0.15 $/1M tks
56.55 tks/sec
398.88 ms
17.68 ms
3811.88 ms
0 sec
0.18 $/1M tks
0.18 $/1M tks
52.37 tks/sec
999.41 ms
19.1 ms
4513.04 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.15 $/1M tks
0.15 $/1M tks
110.91 tks/sec
327.52 ms
9.02 ms
1878.28 ms
0 sec