Back to Benchmarks

llama-3.2-1b-chat

text-generation
Uploaded: 26.09.2024
⏱️ Benchmarks
✨ Query this model
Region:
Hong KongBelgiumIowa
Seq Length:
ShortLong
Providers
provider icon
deepinfra
provider icon
groq
provider icon
fireworks-ai
provider icon
aws-bedrock
Learn more about how we are collecting this data here
Input Cost
Output Cost
Output Tks / SecP90_{P90}
TTFTP90_{P90}
ITLP90_{P90}
E2E LatencyP90_{P90}
Cold Start
0.01 $/1M tks
0.02 $/1M tks
96.29 tks/sec
665.33 ms
10.39 ms
924.97 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.1 $/1M tks
0.1 $/1M tks
298.91 tks/sec
556.69 ms
3.35 ms
563.38 ms
0 sec
0.1 $/1M tks
0.1 $/1M tks
363.81 tks/sec
765.01 ms
2.75 ms
1262.52 ms
0 sec