Back to Benchmarks

llama-3.1-405b-chat

text-generation
Uploaded: 24.07.2024
Seq Length:
Providers
provider icon
vertex-ai
provider icon
azure-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
5.32 $/1M tks
16 $/1M tks
19.22 tks/sec
1596.48 ms
52.04 ms
10234.3 ms
0 sec
5.33 $/1M tks
16 $/1M tks
9.59 tks/sec
524.08 ms
104.25 ms
22834.3 ms
0 sec
5.32 $/1M tks
16 $/1M tks
13.99 tks/sec
1711.94 ms
71.48 ms
14721.74 ms
0 sec
1.79 $/1M tks
1.79 $/1M tks
26.85 tks/sec
523.2 ms
37.24 ms
7674.06 ms
0 sec
3 $/1M tks
3 $/1M tks
101.92 tks/sec
527.86 ms
9.81 ms
2127.11 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
9.5 $/1M tks
9.5 $/1M tks
18.55 tks/sec
1301 ms
53.91 ms
28848.47 ms
0 sec
3.5 $/1M tks
3.5 $/1M tks
106.62 tks/sec
702.41 ms
9.38 ms
2465.65 ms
0 sec