Back to Benchmarks

llama-3-70b-chat

text-generation
Uploaded: 18.04.2024
Seq Length:
Providers
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
groq
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
2.65 $/1M tks
3.5 $/1M tks
53.32 tks/sec
874.34 ms
18.75 ms
17358.31 ms
0 sec
0.35 $/1M tks
0.4 $/1M tks
11.74 tks/sec
735.85 ms
85.17 ms
6101.72 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
131.45 tks/sec
735.83 ms
7.61 ms
1108.59 ms
0 sec
0.59 $/1M tks
0.79 $/1M tks
319.24 tks/sec
739.48 ms
3.13 ms
3665.17 ms
0 sec
0.8 $/1M tks
0.8 $/1M tks
21.13 tks/sec
892.13 ms
47.32 ms
5387.2 ms
0 sec
0.65 $/1M tks
2.75 $/1M tks
44.68 tks/sec
1503.11 ms
22.38 ms
20685.86 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
83.99 tks/sec
1065.72 ms
11.91 ms
11233.04 ms
0 sec