Back to Benchmarks

llama-3.2-1b-chat

text-generation

Uploaded: 26.09.2024

⏱️ Benchmarks

✨ Query this model

Region:

Hong Kong Belgium Iowa

Seq Length:

Providers

deepinfra

fireworks-ai

aws-bedrock

Learn more about how we are collecting this data here

Output Tks / Sec

_{P90}

_{P90}

_{P90}

_{P90}

0.01 $/1M tks

0.02 $/1M tks

96.29 tks/sec

665.33 ms

10.39 ms

924.97 ms

0 sec

0.1 $/1M tks

0.1 $/1M tks

298.91 tks/sec

556.69 ms

3.35 ms

563.38 ms

0 sec

0.1 $/1M tks

0.1 $/1M tks

363.81 tks/sec

765.01 ms

2.75 ms

1262.52 ms

0 sec