Back to Benchmarks

llama-3.1-405b-chat

text-generation
Uploaded: 24.07.2024
Seq Length:
Providers
provider icon
vertex-ai
provider icon
azure-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
5.32 $/1M tks
16 $/1M tks
8.67 tks/sec
1592.23 ms
115.34 ms
23622.95 ms
0 sec
5.33 $/1M tks
16 $/1M tks
9.82 tks/sec
478.35 ms
101.88 ms
1089.63 ms
0 sec
5.32 $/1M tks
16 $/1M tks
13.82 tks/sec
1625.12 ms
72.38 ms
17404.91 ms
0 sec
1.79 $/1M tks
1.79 $/1M tks
23.66 tks/sec
393.24 ms
42.27 ms
689.15 ms
0 sec
3 $/1M tks
3 $/1M tks
93.35 tks/sec
515.85 ms
10.71 ms
2690.47 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
9.5 $/1M tks
9.5 $/1M tks
18.94 tks/sec
1710.03 ms
52.8 ms
28690.16 ms
0 sec
3.5 $/1M tks
3.5 $/1M tks
31.34 tks/sec
710.96 ms
31.9 ms
1285.21 ms
0 sec