Back to Benchmarks

mistral-nemo

text-generation
Uploaded: 24.07.2024
⏱️ Benchmarks
✨ Query this model
Region:
Hong KongBelgiumIowa
Seq Length:
ShortLong
Providers
provider icon
vertex-ai
provider icon
lepton-ai
provider icon
azure-ai
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
mistral-ai
Learn more about how we are collecting this data here
Input Cost
Output Cost
Output Tks / SecP90_{P90}
TTFTP90_{P90}
ITLP90_{P90}
E2E LatencyP90_{P90}
Cold Start
0.15 $/1M tks
0.15 $/1M tks
198.19 tks/sec
628.96 ms
5.05 ms
3237.54 ms
0 sec
0.18 $/1M tks
0.18 $/1M tks
78.77 tks/sec
792.43 ms
12.69 ms
11938.45 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.15 $/1M tks
0.15 $/1M tks
104.37 tks/sec
795.33 ms
9.58 ms
10156.48 ms
0 sec