Back to Benchmarks

llama-3.1-405b-chat

text-generation
Uploaded: 24.07.2024
Seq Length:
Providers
provider icon
together-ai
provider icon
fireworks-ai
provider icon
deepinfra
provider icon
replicate
provider icon
vertex-ai
provider icon
aws-bedrock
provider icon
azure-ai
provider icon
lepton-ai
Learn more about how we are collecting this data here
3.5 $/1M tks
3.5 $/1M tks
105.76 tks/sec
1205.01 ms
9.46 ms
3455.36 ms
0 sec
3 $/1M tks
3 $/1M tks
56.59 tks/sec
668.38 ms
17.67 ms
827.41 ms
0 sec
1.79 $/1M tks
1.79 $/1M tks
19.99 tks/sec
647.41 ms
50.02 ms
9601.69 ms
0 sec
9.5 $/1M tks
9.5 $/1M tks
19.58 tks/sec
1892.26 ms
51.07 ms
12974.38 ms
0 sec
5.32 $/1M tks
16 $/1M tks
19.34 tks/sec
1802.29 ms
51.7 ms
10694.36 ms
0 sec
5.32 $/1M tks
16 $/1M tks
17.73 tks/sec
1893.44 ms
56.4 ms
2739.5 ms
0 sec
5.33 $/1M tks
16 $/1M tks
8.89 tks/sec
2706.98 ms
112.47 ms
11142.42 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed