Back to Benchmarks

llama-3.2-11b-chat

text-generation

Uploaded: 26.09.2024

⏱️ Benchmarks

✨ Query this model

Region:

Hong Kong Belgium Iowa

Seq Length:

Providers

together-ai

deepinfra

azure-ai

fireworks-ai

vertex-ai

Learn more about how we are collecting this data here

Output Tks / Sec

_{P90}

_{P90}

_{P90}

_{P90}

0.18 $/1M tks

0.18 $/1M tks

94.53 tks/sec

717.31 ms

10.58 ms

907.72 ms

0 sec

0.06 $/1M tks

0.06 $/1M tks

70.03 tks/sec

406.66 ms

14.28 ms

2977.05 ms

0 sec

Not computed

Not computed

Not computed

Not computed

Not computed

Not computed

Not computed

0.2 $/1M tks

0.2 $/1M tks

121.29 tks/sec

429.54 ms

8.24 ms

1245.76 ms

0 sec

0.35 $/1M tks

0.35 $/1M tks

25.82 tks/sec

1445.52 ms

38.74 ms

9502.57 ms

0 sec