Back to Benchmarks

llama-3.2-3b-chat

text-generation
Uploaded: 26.09.2024
Seq Length:
Providers
provider icon
together-ai
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
aws-bedrock
Learn more about how we are collecting this data here
0.06 $/1M tks
0.06 $/1M tks
190.78 tks/sec
729.75 ms
5.24 ms
5724.96 ms
0 sec
0.03 $/1M tks
0.05 $/1M tks
88.29 tks/sec
706.57 ms
11.33 ms
10367.83 ms
0 sec
0.1 $/1M tks
0.1 $/1M tks
207.08 tks/sec
627.81 ms
4.83 ms
656.78 ms
0 sec
0.15 $/1M tks
0.15 $/1M tks
148.87 tks/sec
1037.1 ms
6.72 ms
5880.32 ms
0 sec