Back to Benchmarks

llama-3-70b-chat

text-generation
Uploaded: 18.04.2024
Seq Length:
Providers
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
groq
provider icon
lepton-ai
provider icon
replicate
provider icon
together-ai
Learn more about how we are collecting this data here
2.65 $/1M tks
3.5 $/1M tks
55.73 tks/sec
516.23 ms
17.94 ms
3799.88 ms
0 sec
0.35 $/1M tks
0.4 $/1M tks
18.64 tks/sec
579.57 ms
53.64 ms
2027.8 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
145.3 tks/sec
404.71 ms
6.88 ms
1849.97 ms
0 sec
0.59 $/1M tks
0.79 $/1M tks
299.63 tks/sec
334.55 ms
3.34 ms
1005.37 ms
0 sec
0.8 $/1M tks
0.8 $/1M tks
38.77 tks/sec
590.15 ms
25.79 ms
5413.6 ms
0 sec
0.65 $/1M tks
2.75 $/1M tks
51.74 tks/sec
1492.32 ms
19.33 ms
5918.51 ms
0 sec
0.9 $/1M tks
0.9 $/1M tks
49.11 tks/sec
483.06 ms
20.36 ms
849.58 ms
0 sec