Back to Benchmarks

llama-3-70b-chat

text-generation
Uploaded: 18.04.2024
Seq Length:
Providers
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
groq
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
2.65 $/1M tks
3.5 $/1M tks
56.44 tks/sec
777.48 ms
17.72 ms
4215.02 ms
0 sec
0.35 $/1M tks
0.4 $/1M tks
13.73 tks/sec
613.12 ms
72.83 ms
14960.62 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
151.52 tks/sec
637.9 ms
6.6 ms
1911.62 ms
0 sec
0.59 $/1M tks
0.79 $/1M tks
296.29 tks/sec
592.32 ms
3.38 ms
1172.84 ms
0 sec
0.8 $/1M tks
0.8 $/1M tks
29.57 tks/sec
697.67 ms
33.82 ms
5973.66 ms
0 sec
0.65 $/1M tks
2.75 $/1M tks
56.89 tks/sec
2034.43 ms
17.58 ms
5338.92 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
78.22 tks/sec
926.64 ms
12.78 ms
3023.22 ms
0 sec