Back to Benchmarks

llama-3-8b-chat

text-generation
Uploaded: 18.04.2024
Seq Length:
Providers
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
groq
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
0.3 $/1M tks
0.6 $/1M tks
79.62 tks/sec
755.79 ms
12.56 ms
2777.99 ms
0 sec
0.06 $/1M tks
0.06 $/1M tks
110.84 tks/sec
611.67 ms
9.02 ms
2551.43 ms
0 sec
0.2 $/1M tks
0.2 $/1M tks
253.01 tks/sec
598.07 ms
3.95 ms
1392.5 ms
0 sec
0.05 $/1M tks
0.08 $/1M tks
354.89 tks/sec
754.24 ms
2.82 ms
2926.74 ms
0 sec
0.07 $/1M tks
0.07 $/1M tks
99.94 tks/sec
886.49 ms
10.01 ms
1296.75 ms
0 sec
0.05 $/1M tks
0.25 $/1M tks
16.76 tks/sec
1658.9 ms
59.67 ms
47309.09 ms
0 sec
0.2 $/1M tks
0.2 $/1M tks
135.8 tks/sec
791.45 ms
7.36 ms
1130.17 ms
0 sec