Back to Benchmarks

llama-3.2-3b-chat

text-generation
Uploaded: 26.09.2024
⏱️ Benchmarks
✨ Query this model
Region:
Hong KongBelgiumIowa
Seq Length:
ShortLong
Providers
provider icon
together-ai
provider icon
deepinfra
provider icon
groq
provider icon
fireworks-ai
provider icon
aws-bedrock
provider icon
lepton-ai
Learn more about how we are collecting this data here
Input Cost
Output Cost
Output Tks / SecP90_{P90}
TTFTP90_{P90}
ITLP90_{P90}
E2E LatencyP90_{P90}
Cold Start
0.06 $/1M tks
0.06 $/1M tks
222.69 tks/sec
100952.77 ms
4.49 ms
101814.98 ms
0 sec
0.03 $/1M tks
0.05 $/1M tks
90.82 tks/sec
395.58 ms
11.01 ms
2542.58 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.1 $/1M tks
0.1 $/1M tks
273.1 tks/sec
343.77 ms
3.66 ms
611.07 ms
0 sec
0.15 $/1M tks
0.15 $/1M tks
268.35 tks/sec
777.47 ms
3.73 ms
1142.67 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed