Back to Benchmarks

mistral-nemo

text-generation
Uploaded: 24.07.2024
⏱️ Benchmarks
✨ Query this model
Region:
Hong KongBelgiumIowa
Seq Length:
ShortLong
Providers
provider icon
vertex-ai
provider icon
lepton-ai
provider icon
azure-ai
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
mistral-ai
Learn more about how we are collecting this data here
Input Cost
Output Cost
Output Tks / SecP90_{P90}
TTFTP90_{P90}
ITLP90_{P90}
E2E LatencyP90_{P90}
Cold Start
0.15 $/1M tks
0.15 $/1M tks
51.54 tks/sec
362.8 ms
19.4 ms
3680.88 ms
0 sec
0.18 $/1M tks
0.18 $/1M tks
28.79 tks/sec
560.82 ms
34.74 ms
6882.89 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.15 $/1M tks
0.15 $/1M tks
119.26 tks/sec
532.55 ms
8.38 ms
2159.18 ms
0 sec