PRICE~moonshotai/kimi-latest cached_input_per_mtok increased from 0.29 to 0.808m PRICE~moonshotai/kimi-latest output_per_mtok increased from 11.36 to 13.008m PRICE~moonshotai/kimi-latest input_per_mtok increased from 0.75 to 0.988m PRICE~deepseek/deepseek-pro-latest input_per_mtok decreased from 0.13 to 0.1339m PRICE~deepseek/deepseek-pro-latest output_per_mtok increased from 0.40 to 4.2039m PRICE~deepseek/deepseek-pro-latest cached_input_per_mtok increased from 0.0042 to 0.1039m PRICE~moonshotai/kimi-latest input_per_mtok decreased from 0.99 to 0.7539m PRICE~moonshotai/kimi-latest output_per_mtok decreased from 13.00 to 11.3639m PRICE~moonshotai/kimi-latest cached_input_per_mtok decreased from 0.80 to 0.2939m PRICE~moonshotai/kimi-latest input_per_mtok increased from 0.75 to 0.991h PRICE~moonshotai/kimi-latest output_per_mtok increased from 11.36 to 13.001h PRICE~moonshotai/kimi-latest cached_input_per_mtok increased from 0.29 to 0.801h PERFORMANCEGLM-5.2 → Scaleway: TTFT ↑ 20%2h PERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↑ 35%2h PERFORMANCEMistral Medium 3.5 → Scaleway: TTFT ↓ 21%2h PERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↓ 20%2h PERFORMANCEGPT-OSS 120B → Scaleway: throughput ↑ 31%2h PERFORMANCEGPT-OSS 120B → Scaleway: TTFT ↓ 24%2h PERFORMANCEGPT-OSS 120B → Together AI: throughput ↑ 20%2h PERFORMANCEKimi K3 via OpenRouter: TTFT ↓ 49%2h PERFORMANCEGLM-5.2 via OpenRouter: reliability recovered 96.8% → 100.0%2h PERFORMANCEKimi K3 via Cortecs: throughput ↑ 184%2h PERFORMANCEKimi K3 via Cortecs: TTFT ↓ 42%2h PERFORMANCEGLM-5.2 via OpenRouter: throughput ↓ 49%2h PERFORMANCEGLM-5.2 via OpenRouter: TTFT ↑ 121%2h PERFORMANCEMiniMax M3 via OpenRouter: reliability recovered 96.8% → 100.0%2h PERFORMANCEDeepSeek V4 Pro via Cortecs: throughput ↑ 27%2h PERFORMANCEGPT-OSS 120B via OpenRouter: throughput ↓ 22%2h PERFORMANCEGLM-4.7 via OpenRouter: TTFT ↓ 78%2h PERFORMANCEGPT-OSS 20B → Groq: TTFT ↑ 24%2h PERFORMANCEKimi K3 → Together AI: TTFT ↓ 34%2h PERFORMANCEDeepSeek V4 Flash via OpenRouter: throughput ↓ 17%2h PERFORMANCELlama 3.3 70B via Cortecs: TTFT ↓ 51%2h PERFORMANCEQwen3 235B via OpenRouter: throughput ↑ 37%2h PERFORMANCEQwen3 235B via OpenRouter: TTFT ↓ 29%2h PERFORMANCEDeepSeek V4 Flash → Together AI: throughput ↑ 19%2h PERFORMANCEGLM-5.3 via OpenRouter: throughput ↓ 17%2h PERFORMANCEGPT-OSS 20B via Cortecs: throughput ↑ 28%2h PERFORMANCELlama 3.3 70B → Together AI: TTFT ↓ 33%2h PRICEtencent/hy4-preview output_per_mtok increased from 2.25 to 2.502h

PRICE~moonshotai/kimi-latest cached_input_per_mtok increased from 0.29 to 0.808m PRICE~moonshotai/kimi-latest output_per_mtok increased from 11.36 to 13.008m PRICE~moonshotai/kimi-latest input_per_mtok increased from 0.75 to 0.988m PRICE~deepseek/deepseek-pro-latest input_per_mtok decreased from 0.13 to 0.1339m PRICE~deepseek/deepseek-pro-latest output_per_mtok increased from 0.40 to 4.2039m PRICE~deepseek/deepseek-pro-latest cached_input_per_mtok increased from 0.0042 to 0.1039m PRICE~moonshotai/kimi-latest input_per_mtok decreased from 0.99 to 0.7539m PRICE~moonshotai/kimi-latest output_per_mtok decreased from 13.00 to 11.3639m PRICE~moonshotai/kimi-latest cached_input_per_mtok decreased from 0.80 to 0.2939m PRICE~moonshotai/kimi-latest input_per_mtok increased from 0.75 to 0.991h PRICE~moonshotai/kimi-latest output_per_mtok increased from 11.36 to 13.001h PRICE~moonshotai/kimi-latest cached_input_per_mtok increased from 0.29 to 0.801h PERFORMANCEGLM-5.2 → Scaleway: TTFT ↑ 20%2h PERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↑ 35%2h PERFORMANCEMistral Medium 3.5 → Scaleway: TTFT ↓ 21%2h PERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↓ 20%2h PERFORMANCEGPT-OSS 120B → Scaleway: throughput ↑ 31%2h PERFORMANCEGPT-OSS 120B → Scaleway: TTFT ↓ 24%2h PERFORMANCEGPT-OSS 120B → Together AI: throughput ↑ 20%2h PERFORMANCEKimi K3 via OpenRouter: TTFT ↓ 49%2h PERFORMANCEGLM-5.2 via OpenRouter: reliability recovered 96.8% → 100.0%2h PERFORMANCEKimi K3 via Cortecs: throughput ↑ 184%2h PERFORMANCEKimi K3 via Cortecs: TTFT ↓ 42%2h PERFORMANCEGLM-5.2 via OpenRouter: throughput ↓ 49%2h PERFORMANCEGLM-5.2 via OpenRouter: TTFT ↑ 121%2h PERFORMANCEMiniMax M3 via OpenRouter: reliability recovered 96.8% → 100.0%2h PERFORMANCEDeepSeek V4 Pro via Cortecs: throughput ↑ 27%2h PERFORMANCEGPT-OSS 120B via OpenRouter: throughput ↓ 22%2h PERFORMANCEGLM-4.7 via OpenRouter: TTFT ↓ 78%2h PERFORMANCEGPT-OSS 20B → Groq: TTFT ↑ 24%2h PERFORMANCEKimi K3 → Together AI: TTFT ↓ 34%2h PERFORMANCEDeepSeek V4 Flash via OpenRouter: throughput ↓ 17%2h PERFORMANCELlama 3.3 70B via Cortecs: TTFT ↓ 51%2h PERFORMANCEQwen3 235B via OpenRouter: throughput ↑ 37%2h PERFORMANCEQwen3 235B via OpenRouter: TTFT ↓ 29%2h PERFORMANCEDeepSeek V4 Flash → Together AI: throughput ↑ 19%2h PERFORMANCEGLM-5.3 via OpenRouter: throughput ↓ 17%2h PERFORMANCEGPT-OSS 20B via Cortecs: throughput ↑ 28%2h PERFORMANCELlama 3.3 70B → Together AI: TTFT ↓ 33%2h PRICEtencent/hy4-preview output_per_mtok increased from 2.25 to 2.502h

GPT-OSS 20B

6 providers · 21B MoE · 128k context · 2 regions · all models →

GPT-OSS 20B across 6 providers

Same model. Different infrastructure.

TTFT spread3.8×Throughput spread13.9×Output price3.3×Tool reliability0.0 pts

TTFT175 ms670 msbest: Cortecs

Throughput67 tok/s929 tok/sbest: Groq

Output price$0.09/M$0.30/Mbest: OpenRouter

Reliability99.5%100.0%best: OpenRouter

Tool success100.0%100.0%best: Cortecs

GPT-OSS 20B — tool-calling benchmark

3 providers · 100.0% → 100.0% · 0.0 pt spread

#	Provider	Tools	Δ best	Rel.	JSON	TTFT	P95	Tok/s	$ Out
01	Groq	100.0%	—	100.0%	100.0%	258 ms	368 ms	929	$0.30
02	OpenRouter	100.0%	−0.0	100.0%	94.4%	670 ms	1896 ms	79	$0.09
03	Cortecs	100.0%	−0.0	99.5%	100.0%	175 ms	588 ms	67	$0.17

GPT-OSS 20B inference benchmark: fastest & cheapest providers · InferenceBench