Back to Benchmarks

llama-3.1-405b-chat

text-generation
Uploaded: 24.07.2024
Seq Length:
Providers
provider icon
vertex-ai
provider icon
azure-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
5.32 $/1M tks
16 $/1M tks
28.11 tks/sec
2053.85 ms
35.58 ms
35641.55 ms
0 sec
5.33 $/1M tks
16 $/1M tks
8.44 tks/sec
847.04 ms
118.47 ms
31057.83 ms
0 sec
5.32 $/1M tks
16 $/1M tks
13.94 tks/sec
2366.84 ms
71.72 ms
13053.18 ms
0 sec
1.79 $/1M tks
1.79 $/1M tks
20.11 tks/sec
836.02 ms
49.72 ms
1184.03 ms
0 sec
3 $/1M tks
3 $/1M tks
59.54 tks/sec
843.79 ms
16.8 ms
2305.04 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
9.5 $/1M tks
9.5 $/1M tks
19.01 tks/sec
2094.13 ms
52.6 ms
7143.57 ms
0 sec
3.5 $/1M tks
3.5 $/1M tks
78.25 tks/sec
1204.56 ms
12.78 ms
13805.09 ms
0 sec