Back to Benchmarks

mistral-nemo

text-generation
Uploaded: 24.07.2024
⏱️ Benchmarks
✨ Query this model
Region:
Hong KongBelgiumIowa
Seq Length:
ShortLong
Providers
provider icon
vertex-ai
provider icon
lepton-ai
provider icon
azure-ai
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
mistral-ai
Learn more about how we are collecting this data here
Input Cost
Output Cost
Output Tks / SecP90_{P90}
TTFTP90_{P90}
ITLP90_{P90}
E2E LatencyP90_{P90}
Cold Start
0.15 $/1M tks
0.15 $/1M tks
59.54 tks/sec
545.31 ms
16.8 ms
4038.67 ms
0 sec
0.18 $/1M tks
0.18 $/1M tks
85.52 tks/sec
714.63 ms
11.69 ms
3123.53 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.15 $/1M tks
0.15 $/1M tks
108.76 tks/sec
606.41 ms
9.19 ms
1801.7 ms
0 sec