Back to Benchmarks

mixtral-8x7b-instruct-v0.1

text-generation
Uploaded: 09.01.2024
Seq Length:
Providers
provider icon
mistral-ai
provider icon
lepton-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
octoai
provider icon
replicate
provider icon
together-ai
provider icon
groq
Learn more about how we are collecting this data here
0.7 $/1M tks
0.7 $/1M tks
94.5 tks/sec
385.05 ms
10.58 ms
2067.63 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
102.85 tks/sec
396.39 ms
9.72 ms
2506.3 ms
0 sec
0.45 $/1M tks
0.7 $/1M tks
67.32 tks/sec
480.9 ms
14.85 ms
2664.47 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
41.61 tks/sec
381.62 ms
24.03 ms
5476.29 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
112.36 tks/sec
378.44 ms
8.9 ms
2033.86 ms
0 sec
0.45 $/1M tks
0.45 $/1M tks
155.87 tks/sec
489.69 ms
6.42 ms
1708.63 ms
0 sec
0.3 $/1M tks
1 $/1M tks
106.73 tks/sec
1481.75 ms
9.37 ms
3093.27 ms
0 sec
0.6 $/1M tks
0.6 $/1M tks
110.61 tks/sec
423.51 ms
9.04 ms
1861 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
326.9 tks/sec
337.4 ms
3.06 ms
836.02 ms
0 sec