Back to Benchmarks

llama-3-8b-chat

text-generation
Uploaded: 18.04.2024
Seq Length:
Providers
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
groq
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
0.3 $/1M tks
0.6 $/1M tks
79.27 tks/sec
707.15 ms
12.61 ms
3091.29 ms
0 sec
0.06 $/1M tks
0.06 $/1M tks
93.19 tks/sec
563.81 ms
10.73 ms
832.08 ms
0 sec
0.2 $/1M tks
0.2 $/1M tks
224 tks/sec
586.83 ms
4.46 ms
1644.88 ms
0 sec
0.05 $/1M tks
0.08 $/1M tks
286.81 tks/sec
631.56 ms
3.49 ms
1276.59 ms
0 sec
0.07 $/1M tks
0.07 $/1M tks
84.41 tks/sec
781.09 ms
11.85 ms
1183.89 ms
0 sec
0.05 $/1M tks
0.25 $/1M tks
25.47 tks/sec
2071.57 ms
39.25 ms
5486.74 ms
0 sec
0.2 $/1M tks
0.2 $/1M tks
257.69 tks/sec
955.92 ms
3.88 ms
1553.54 ms
0 sec