PRICE~moonshotai/kimi-latest cached_input_per_mtok increased from 0.29 to 0.809mPRICE~moonshotai/kimi-latest output_per_mtok increased from 11.36 to 13.009mPRICE~moonshotai/kimi-latest input_per_mtok increased from 0.75 to 0.989mPRICE~deepseek/deepseek-pro-latest input_per_mtok decreased from 0.13 to 0.1340mPRICE~deepseek/deepseek-pro-latest output_per_mtok increased from 0.40 to 4.2040mPRICE~deepseek/deepseek-pro-latest cached_input_per_mtok increased from 0.0042 to 0.1040mPRICE~moonshotai/kimi-latest input_per_mtok decreased from 0.99 to 0.7540mPRICE~moonshotai/kimi-latest output_per_mtok decreased from 13.00 to 11.3640mPRICE~moonshotai/kimi-latest cached_input_per_mtok decreased from 0.80 to 0.2940mPRICE~moonshotai/kimi-latest input_per_mtok increased from 0.75 to 0.991hPRICE~moonshotai/kimi-latest output_per_mtok increased from 11.36 to 13.001hPRICE~moonshotai/kimi-latest cached_input_per_mtok increased from 0.29 to 0.801hPERFORMANCEGLM-5.2 → Scaleway: TTFT ↑ 20%2hPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↑ 35%2hPERFORMANCEMistral Medium 3.5 → Scaleway: TTFT ↓ 21%2hPERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↓ 20%2hPERFORMANCEGPT-OSS 120B → Scaleway: throughput ↑ 31%2hPERFORMANCEGPT-OSS 120B → Scaleway: TTFT ↓ 24%2hPERFORMANCEGPT-OSS 120B → Together AI: throughput ↑ 20%2hPERFORMANCEKimi K3 via OpenRouter: TTFT ↓ 49%2hPERFORMANCEGLM-5.2 via OpenRouter: reliability recovered 96.8% → 100.0%2hPERFORMANCEKimi K3 via Cortecs: throughput ↑ 184%2hPERFORMANCEKimi K3 via Cortecs: TTFT ↓ 42%2hPERFORMANCEGLM-5.2 via OpenRouter: throughput ↓ 49%2hPERFORMANCEGLM-5.2 via OpenRouter: TTFT ↑ 121%2hPERFORMANCEMiniMax M3 via OpenRouter: reliability recovered 96.8% → 100.0%2hPERFORMANCEDeepSeek V4 Pro via Cortecs: throughput ↑ 27%2hPERFORMANCEGPT-OSS 120B via OpenRouter: throughput ↓ 22%2hPERFORMANCEGLM-4.7 via OpenRouter: TTFT ↓ 78%2hPERFORMANCEGPT-OSS 20B → Groq: TTFT ↑ 24%2hPERFORMANCEKimi K3 → Together AI: TTFT ↓ 34%2hPERFORMANCEDeepSeek V4 Flash via OpenRouter: throughput ↓ 17%2hPERFORMANCELlama 3.3 70B via Cortecs: TTFT ↓ 51%2hPERFORMANCEQwen3 235B via OpenRouter: throughput ↑ 37%2hPERFORMANCEQwen3 235B via OpenRouter: TTFT ↓ 29%2hPERFORMANCEDeepSeek V4 Flash → Together AI: throughput ↑ 19%2hPERFORMANCEGLM-5.3 via OpenRouter: throughput ↓ 17%2hPERFORMANCEGPT-OSS 20B via Cortecs: throughput ↑ 28%2hPERFORMANCELlama 3.3 70B → Together AI: TTFT ↓ 33%2hPRICEtencent/hy4-preview output_per_mtok increased from 2.25 to 2.502h

GPT-OSS 120B

11 providers · 117B MoE · 128k context · 2 regions · all models →

GPT-OSS 120B across 11 providers

Same model. Different infrastructure.
TTFT spread2.6×Throughput spread25.7×Output price4.4×Tool reliability0.0 pts
TTFT179 ms474 msbest: Scaleway
Throughput68 tok/s1749 tok/sbest: Cerebras
Output price$0.17/M$0.75/Mbest: OpenRouter
Reliability93.5%100.0%best: Scaleway
Tool success100.0%100.0%best: Scaleway

GPT-OSS 120B — tool-calling benchmark

6 providers · 100.0% → 100.0% · 0.0 pt spread
#ProviderToolsΔ bestRel.JSONTTFTP95Tok/s$ Out
01Cerebras100.0%—100.0%100.0%184 ms323 ms1749$0.75
02Groq100.0%−0.0100.0%100.0%265 ms400 ms486$0.60
03OpenRouter100.0%−0.099.1%100.0%474 ms1413 ms68$0.17
04Cortecs100.0%−0.0100.0%100.0%237 ms521 ms351$0.46
05Together100.0%−0.093.5%85.7%182 ms467 ms138$0.60
06Scaleway100.0%−0.0100.0%100.0%179 ms2214 ms96$0.69
GPT-OSS 120B inference benchmark: fastest & cheapest providers · InferenceBench