Back to Benchmarks

mixtral-8x7b-instruct-v0.1

text-generation
Uploaded: 09.01.2024
Seq Length:
Providers
provider icon
mistral-ai
provider icon
lepton-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
octoai
provider icon
replicate
provider icon
together-ai
provider icon
groq
Learn more about how we are collecting this data here
0.7 $/1M tks
0.7 $/1M tks
60.44 tks/sec
476.46 ms
16.54 ms
3504.1 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
117.08 tks/sec
492.11 ms
8.54 ms
2097.86 ms
0 sec
0.45 $/1M tks
0.7 $/1M tks
80.69 tks/sec
535.82 ms
12.39 ms
2642.71 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
36.68 tks/sec
520.44 ms
27.27 ms
4719.28 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
102.45 tks/sec
466.92 ms
9.76 ms
2194.65 ms
0 sec
0.45 $/1M tks
0.45 $/1M tks
170.68 tks/sec
588.95 ms
5.86 ms
1637.69 ms
0 sec
0.3 $/1M tks
1 $/1M tks
90.91 tks/sec
1219.29 ms
11 ms
3089.18 ms
0 sec
0.6 $/1M tks
0.6 $/1M tks
111.61 tks/sec
845.38 ms
8.96 ms
2458.07 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
249.31 tks/sec
403.8 ms
4.01 ms
1242.11 ms
0 sec