Back to Benchmarks

mixtral-8x7b-instruct-v0.1

text-generation
Uploaded: 09.01.2024
Seq Length:
Providers
provider icon
mistral-ai
provider icon
lepton-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
octoai
provider icon
replicate
provider icon
together-ai
provider icon
groq
Learn more about how we are collecting this data here
0.7 $/1M tks
0.7 $/1M tks
77.66 tks/sec
991.61 ms
12.88 ms
3051.76 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
77.33 tks/sec
661.14 ms
12.93 ms
3221.57 ms
0 sec
0.45 $/1M tks
0.7 $/1M tks
73.85 tks/sec
697.46 ms
13.54 ms
3202.43 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
43.06 tks/sec
675.07 ms
23.22 ms
4994.29 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
116.23 tks/sec
725.1 ms
8.6 ms
2196.27 ms
0 sec
0.45 $/1M tks
0.45 $/1M tks
175.21 tks/sec
715 ms
5.71 ms
1628.17 ms
0 sec
0.3 $/1M tks
1 $/1M tks
114.66 tks/sec
1674.58 ms
8.72 ms
3488.57 ms
0 sec
0.6 $/1M tks
0.6 $/1M tks
88.01 tks/sec
761.13 ms
11.36 ms
2488.16 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
296.81 tks/sec
569.4 ms
3.37 ms
1253.34 ms
0 sec