Back to Benchmarks

llama-3.2-3b-chat

text-generation
Uploaded: 26.09.2024
Seq Length:
Providers
provider icon
together-ai
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
aws-bedrock
Learn more about how we are collecting this data here
0.06 $/1M tks
0.06 $/1M tks
180.36 tks/sec
418.63 ms
5.54 ms
5563.99 ms
0 sec
0.03 $/1M tks
0.05 $/1M tks
78.29 tks/sec
459.1 ms
12.77 ms
13168.1 ms
0 sec
0.1 $/1M tks
0.1 $/1M tks
238.21 tks/sec
320.42 ms
4.2 ms
421.17 ms
0 sec
0.15 $/1M tks
0.15 $/1M tks
146.14 tks/sec
805.39 ms
6.84 ms
7504.49 ms
0 sec