Back to Benchmarks

mixtral-8x7b-instruct-v0.1

text-generation
Uploaded: 09.01.2024
Seq Length:
Providers
provider icon
mistral-ai
provider icon
lepton-ai
provider icon
aws-bedrock
provider icon
deepinfra
provider icon
fireworks-ai
provider icon
octoai
provider icon
replicate
provider icon
together-ai
provider icon
groq
Learn more about how we are collecting this data here
0.7 $/1M tks
0.7 $/1M tks
94.32 tks/sec
598.07 ms
10.6 ms
10489.66 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
91.75 tks/sec
696.38 ms
10.9 ms
8729.38 ms
0 sec
0.45 $/1M tks
0.7 $/1M tks
76.92 tks/sec
771.09 ms
13 ms
13199.3 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
44.51 tks/sec
719.3 ms
22.47 ms
20020.49 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
121.21 tks/sec
662.44 ms
8.25 ms
8400.91 ms
0 sec
0.45 $/1M tks
0.45 $/1M tks
92.2 tks/sec
756.14 ms
10.85 ms
10810.6 ms
0 sec
0.3 $/1M tks
1 $/1M tks
85.47 tks/sec
1509.54 ms
11.7 ms
11653.71 ms
0 sec
0.6 $/1M tks
0.6 $/1M tks
131.25 tks/sec
767.9 ms
7.62 ms
7198.45 ms
0 sec
0.24 $/1M tks
0.24 $/1M tks
318.42 tks/sec
679.96 ms
3.14 ms
3399.6 ms
0 sec