Back to Benchmarks

llama-3-70b-chat

text-generation
Uploaded: 18.04.2024
Seq Length:
Providers
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
groq
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
2.65 $/1M tks
3.5 $/1M tks
53.65 tks/sec
658.94 ms
18.64 ms
7816.74 ms
0 sec
0.35 $/1M tks
0.4 $/1M tks
27.6 tks/sec
617.47 ms
36.24 ms
34100.34 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
109.85 tks/sec
675.41 ms
9.1 ms
966.71 ms
0 sec
0.59 $/1M tks
0.79 $/1M tks
231.04 tks/sec
472.37 ms
4.33 ms
580.58 ms
0 sec
0.8 $/1M tks
0.8 $/1M tks
32.33 tks/sec
704.54 ms
30.93 ms
29192.7 ms
0 sec
0.65 $/1M tks
2.75 $/1M tks
60.79 tks/sec
1608.46 ms
16.45 ms
2414.55 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
62.85 tks/sec
598.04 ms
15.91 ms
1107.22 ms
0 sec