Back to Benchmarks

llama-3.2-3b-chat

text-generation

Uploaded: 26.09.2024

⏱️ Benchmarks

✨ Query this model

Region:

Hong Kong Belgium Iowa

Seq Length:

Providers

together-ai

deepinfra

fireworks-ai

aws-bedrock

Learn more about how we are collecting this data here

Output Tks / Sec

_{P90}

_{P90}

_{P90}

_{P90}

0.06 $/1M tks

0.06 $/1M tks

222.69 tks/sec

100952.77 ms

4.49 ms

101814.98 ms

0 sec

0.03 $/1M tks

0.05 $/1M tks

90.82 tks/sec

395.58 ms

11.01 ms

2542.58 ms

0 sec

0.1 $/1M tks

0.1 $/1M tks

273.1 tks/sec

343.77 ms

3.66 ms

611.07 ms

0 sec

0.15 $/1M tks

0.15 $/1M tks

268.35 tks/sec

777.47 ms

3.73 ms

1142.67 ms

0 sec