Benchmarked models
DEV DATA| Model | Family | Context | Providers | Best provider | Best TTFT | Best $/M out |
|---|
| Qwen3-235B | Qwen | 128k | 12 | Fireworks 97.8 | 148 ms | $0.31 |
| DeepSeek-V3 | DeepSeek | 128k | 6 | Fireworks 97.6 | 340 ms | $0.39 |
| Llama 3.3 70B | Llama | 128k | 10 | Fireworks 97.0 | 110 ms | $0.20 |
| GLM-5.2 | GLM | — | 1 | Cortecs 94.5 | 525 ms | $0.51 |
| GLM-4.7 | GLM | — | 1 | Cortecs 93.8 | 1311 ms | $0.42 |
| DeepSeek V4 Pro | DeepSeek | — | 1 | Cortecs 94.0 | 381 ms | $0.66 |
| Kimi K3 | Kimi | — | 1 | Cortecs 94.3 | 1777 ms | $0.60 |
| MiniMax M3 | MiniMax | — | 1 | Cortecs 93.8 | 2253 ms | $0.48 |
Observed across the registry
Live discovery data