Back to Benchmarks

llama-2-7b-chat

text-generation

Uploaded: 09.01.2024

⏱️ Benchmarks

✨ Query this model

Region:

Hong Kong Belgium Iowa

Seq Length:

Providers

replicate

lepton-ai

Learn more about how we are collecting this data here

Output Tks / Sec

_{P90}

_{P90}

_{P90}

_{P90}

0.05 $/1M tks

0.25 $/1M tks

319.19 tks/sec

1295.98 ms

3.13 ms

1659.4 ms

0 sec

0.07 $/1M tks

0.07 $/1M tks

96.36 tks/sec

889.26 ms

10.38 ms

1086.44 ms

0 sec