Back to Benchmarks

llama-3-70b-chat

text-generation
Uploaded: 18.04.2024
Seq Length:
Providers
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
groq
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
2.65 $/1M tks
3.5 $/1M tks
56.7 tks/sec
608.13 ms
17.64 ms
3624.01 ms
0 sec
0.35 $/1M tks
0.4 $/1M tks
33.58 tks/sec
671.6 ms
29.78 ms
5883.04 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
160.42 tks/sec
422.15 ms
6.23 ms
1637.7 ms
0 sec
0.59 $/1M tks
0.79 $/1M tks
291.12 tks/sec
1431.68 ms
3.44 ms
2036.25 ms
0 sec
0.8 $/1M tks
0.8 $/1M tks
41.35 tks/sec
698.88 ms
24.19 ms
5318.3 ms
0 sec
0.65 $/1M tks
2.75 $/1M tks
59.81 tks/sec
1426.29 ms
16.72 ms
3031.31 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
65.4 tks/sec
550.58 ms
15.29 ms
3180.54 ms
0 sec