Back to Benchmarks

llama-3.2-3b-chat

text-generation
Uploaded: 26.09.2024
Seq Length:
Providers
provider icon
together-ai
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
aws-bedrock
Learn more about how we are collecting this data here
0.06 $/1M tks
0.06 $/1M tks
100.26 tks/sec
488.45 ms
9.97 ms
648.03 ms
0 sec
0.03 $/1M tks
0.05 $/1M tks
89.92 tks/sec
480.53 ms
11.12 ms
847.52 ms
0 sec
0.1 $/1M tks
0.1 $/1M tks
321.41 tks/sec
437.74 ms
3.11 ms
459.52 ms
0 sec
0.15 $/1M tks
0.15 $/1M tks
186.88 tks/sec
858.01 ms
5.35 ms
1864.03 ms
0 sec