Back to Benchmarks

mixtral-8x7b-instruct-v0.1

text-generation
Uploaded: 09.01.2024
Seq Length:
Providers
provider icon
mistral-ai
provider icon
lepton-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
octoai
provider icon
replicate
provider icon
together-ai
provider icon
groq
Learn more about how we are collecting this data here
0.7 $/1M tks
0.7 $/1M tks
94.84 tks/sec
812.65 ms
10.54 ms
10365.97 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
42.11 tks/sec
720.21 ms
23.75 ms
20123.61 ms
0 sec
0.45 $/1M tks
0.7 $/1M tks
78.37 tks/sec
468.35 ms
12.76 ms
12921.57 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
37.9 tks/sec
422.45 ms
26.39 ms
21979.48 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
111.83 tks/sec
358.62 ms
8.94 ms
8371.12 ms
0 sec
0.45 $/1M tks
0.45 $/1M tks
126.07 tks/sec
500.77 ms
7.93 ms
7473.35 ms
0 sec
0.3 $/1M tks
1 $/1M tks
92.13 tks/sec
1529.24 ms
10.85 ms
9441.88 ms
0 sec
0.6 $/1M tks
0.6 $/1M tks
122.54 tks/sec
484.06 ms
8.16 ms
4784.78 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
336.2 tks/sec
411.89 ms
2.97 ms
3285.21 ms
0 sec