The State of AI Inference — August 2026
Who is winning, where the market is moving, and how large the infrastructure gap has become.
- Nebius leads the global provider ranking at 92.7 under the General profile.
- The tool-reliability spread on a single model (Qwen3-235B) reaches 4.5 points across 12 providers.
- Only 3 of 13 ranked providers sit on the price–performance frontier — every other provider is dominated on both axes.
The global ranking
Aggregated across benchmarked models with coverage and freshness shading, Nebius holds #1 with 92.7, followed by Fireworks (91.4) and Groq (90.1). The top of the table is tight; the middle is not — the gap between #1 and the median ranked provider is 6.3 points.
The frontier is narrow
Plotting score against output price, 3 providers are Pareto-dominant. The rest are dominated: for each of them there exists a provider that is simultaneously cheaper and better under this workload profile.
Same model, different result
The thesis holds at market scale: identical models diverge by whole reliability points depending on who serves them. Qwen3-235B's tool-call success ranges 94.7%–99.2% across 12 infrastructures.
- Model selection is only half the decision — provider selection moves reliability and latency by margins that dwarf most model-version differences.
- Frontier position is workload-dependent: re-run the ranking under your own workload profile before committing.
InferenceBench (2026). The State of AI Inference — August 2026. InferenceBench Research.