Back to Benchmarks

llama-3.2-90b-chat

text-generation
Uploaded: 26.09.2024
⏱️ Benchmarks
✨ Query this model
Region:
Hong KongBelgiumIowa
Seq Length:
ShortLong
Providers
provider icon
together-ai
provider icon
deepinfra
provider icon
azure-ai
provider icon
groq
provider icon
fireworks-ai
provider icon
vertex-ai
Learn more about how we are collecting this data here
Input Cost
Output Cost
Output Tks / SecP90_{P90}
TTFTP90_{P90}
ITLP90_{P90}
E2E LatencyP90_{P90}
Cold Start
1.2 $/1M tks
1.2 $/1M tks
47.17 tks/sec
771.03 ms
21.2 ms
1131.45 ms
0 sec
0.35 $/1M tks
0.4 $/1M tks
18.02 tks/sec
1081.49 ms
55.49 ms
61397.01 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.9 $/1M tks
0.9 $/1M tks
52.01 tks/sec
771.25 ms
19.23 ms
19960.66 ms
0 sec
2 $/1M tks
2 $/1M tks
40.26 tks/sec
1793.39 ms
24.84 ms
22906.37 ms
0 sec