Back to Benchmarks

mixtral-8x7b-instruct-v0.1

text-generation
Uploaded: 09.01.2024
Seq Length:
Providers
provider icon
mistral-ai
provider icon
lepton-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
octoai
provider icon
replicate
provider icon
together-ai
provider icon
groq
Learn more about how we are collecting this data here
0.7 $/1M tks
0.7 $/1M tks
96.68 tks/sec
537.21 ms
10.34 ms
5553.69 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
63.65 tks/sec
585.28 ms
15.71 ms
14929.59 ms
0 sec
0.45 $/1M tks
0.7 $/1M tks
67.47 tks/sec
573.38 ms
14.82 ms
11629.61 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
34.06 tks/sec
537.36 ms
29.36 ms
25964.81 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
110.48 tks/sec
445.9 ms
9.05 ms
7759.34 ms
0 sec
0.45 $/1M tks
0.45 $/1M tks
145.39 tks/sec
583.54 ms
6.88 ms
6271.77 ms
0 sec
0.3 $/1M tks
1 $/1M tks
95.84 tks/sec
1232.46 ms
10.43 ms
10935.73 ms
0 sec
0.6 $/1M tks
0.6 $/1M tks
107.96 tks/sec
544.4 ms
9.26 ms
7584.15 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
345.64 tks/sec
461.46 ms
2.89 ms
2527.17 ms
0 sec