Back to Benchmarks

llama-3-70b-chat

text-generation
Uploaded: 18.04.2024
Seq Length:
Providers
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
groq
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
2.65 $/1M tks
3.5 $/1M tks
53.32 tks/sec
611.69 ms
18.75 ms
18278.4 ms
0 sec
0.35 $/1M tks
0.4 $/1M tks
17.2 tks/sec
619.76 ms
58.14 ms
56023.48 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
105.19 tks/sec
382.5 ms
9.51 ms
781.78 ms
0 sec
0.59 $/1M tks
0.79 $/1M tks
304.76 tks/sec
412.89 ms
3.28 ms
4035.44 ms
0 sec
0.8 $/1M tks
0.8 $/1M tks
47 tks/sec
695.49 ms
21.28 ms
3142.39 ms
0 sec
0.65 $/1M tks
2.75 $/1M tks
64.45 tks/sec
1293.28 ms
15.52 ms
2208.74 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
67.55 tks/sec
527.05 ms
14.8 ms
971.18 ms
0 sec