DeepSeek-V3
DeepSeek-V3 across 6 providers
TTFT spread2.0×Throughput spread2.1×Output price2.8×Tool reliability4.1 pts
TTFT340 ms693 msbest: Nebius
Throughput72 tok/s153 tok/sbest: Fireworks
Output price$0.39/M$1.10/Mbest: SiliconFlow
Reliability96.6%99.0%best: Fireworks
Tool success94.8%98.9%best: Fireworks
DeepSeek-V3 — tool-calling benchmark
| # | Provider | Tools | Δ best | Rel. | JSON | TTFT | P95 | Tok/s | $ Out |
|---|---|---|---|---|---|---|---|---|---|
| 01 | Fireworks | 98.9% | — | 99.0% | 99.7% | 368 ms | 1272 ms | 153 | $1.10 |
| 02 | OpenRouter | 98.6% | −0.3 | 97.6% | 98.7% | 453 ms | 1465 ms | 131 | $1.10 |
| 03 | Nebius | 97.7% | −1.2 | 98.9% | 99.1% | 340 ms | 1257 ms | 116 | $0.50 |
| 04 | Together | 96.8% | −2.1 | 97.8% | 98.3% | 473 ms | 1600 ms | 107 | $0.90 |
| 05 | DeepInfra | 96.1% | −2.8 | 97.4% | 98.0% | 604 ms | 1696 ms | 72 | $0.45 |
| 06 | SiliconFlow | 94.8% | −4.1 | 96.6% | 97.7% | 693 ms | 2048 ms | 75 | $0.39 |