Back to Benchmarks

llama-3.1-70b-chat

text-generation
Uploaded: 24.07.2024
Seq Length:
Providers
provider icon
azure-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
lepton-ai
provider icon
octoai
provider icon
perplexity-ai
provider icon
together-ai
provider icon
groq
provider icon
vertex-ai
Learn more about how we are collecting this data here
2.68 $/1M tks
3.54 $/1M tks
25.98 tks/sec
568.51 ms
38.49 ms
6265.1 ms
0 sec
0.99 $/1M tks
0.99 $/1M tks
31.03 tks/sec
984.53 ms
32.23 ms
34150.15 ms
0 sec
0.35 $/1M tks
0.4 $/1M tks
28.77 tks/sec
543.8 ms
34.75 ms
1065.12 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
119.33 tks/sec
552.82 ms
8.38 ms
603.1 ms
0 sec
0.8 $/1M tks
0.8 $/1M tks
59.17 tks/sec
706.36 ms
16.9 ms
909.15 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
71.66 tks/sec
799.87 ms
13.95 ms
13037.48 ms
0 sec
1 $/1M tks
1 $/1M tks
54.17 tks/sec
564.42 ms
18.46 ms
18470.15 ms
0 sec
0.88 $/1M tks
0.88 $/1M tks
46.38 tks/sec
897.01 ms
21.56 ms
1651.67 ms
0 sec
0.59 $/1M tks
0.79 $/1M tks
254.94 tks/sec
857.31 ms
3.92 ms
4846.51 ms
0 sec
0.99 $/1M tks
0.99 $/1M tks
61.33 tks/sec
1596.81 ms
16.31 ms
17397.69 ms
0 sec