PERFORMANCELlama 3.3 70B → Scaleway: throughput ↑ 53%6hPERFORMANCEGLM-5.2 → Scaleway: TTFT ↓ 30%6hPERFORMANCEMistral Medium 3.5 → Scaleway: throughput ↑ 22%6hPERFORMANCEQwen3-235B → Scaleway: throughput ↑ 67%6hPERFORMANCEGPT-5.6 Sol → OpenAI: TTFT ↓ 22%6hPERFORMANCEMistral Large 3 → Mistral AI: TTFT ↓ 21%6hPERFORMANCEGPT-5.6 Luna → OpenAI: throughput ↑ 21%6hPERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↑ 147%6hPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↓ 71%6hPERFORMANCEGPT-OSS 120B → Scaleway: TTFT ↓ 46%6hPERFORMANCEGPT-OSS 120B → Together AI: TTFT ↓ 40%6hPERFORMANCEKimi K3 → Together AI: TTFT ↓ 20%6hPERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↑ 36%30hPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↓ 19%30hPERFORMANCEQwen3-235B → Scaleway: throughput ↑ 19%2dPERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↑ 58%2dPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↑ 21%2dPERFORMANCEGPT-5.6 Sol → OpenAI: throughput ↑ 16%2dPERFORMANCEGPT-OSS 120B → Together AI: TTFT ↑ 22%2dPERFORMANCEKimi K3 → Together AI: throughput ↑ 62%2dPERFORMANCEKimi K3 → Together AI: TTFT ↓ 42%2dPERFORMANCEQwen3-235B → Scaleway: throughput ↑ 30%3dPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↓ 56%3dPERFORMANCELlama 3.3 70B → Scaleway: throughput ↑ 34%3dPERFORMANCELlama 3.3 70B → Scaleway: TTFT ↓ 26%3dPERFORMANCEKimi K3 → Together AI: throughput ↑ 128%3dPERFORMANCEGPT-OSS 120B → Together AI: throughput ↑ 29%3dPERFORMANCEGPT-OSS 120B → Together AI: TTFT ↓ 21%3dPERFORMANCEGPT-OSS 20B → Groq: TTFT ↑ 66%3dPERFORMANCEGLM-5.2 → Together AI: throughput ↑ 47%3dPERFORMANCEMistral Medium 3.5 → Scaleway: TTFT ↑ 18%4dPERFORMANCEGLM-5.2 → Scaleway: throughput ↓ 27%4dPERFORMANCEGLM-5.2 → Scaleway: TTFT ↑ 49%4dPERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↓ 71%4dPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↑ 190%4dPERFORMANCEGPT-5.6 Luna → OpenAI: throughput ↓ 23%4dPERFORMANCELlama 3.3 70B → Scaleway: TTFT ↑ 60%4dPERFORMANCEGLM-5.2 → Together AI: TTFT ↓ 25%4dPERFORMANCEGPT-OSS 120B → Together AI: throughput ↓ 16%4dPERFORMANCEGPT-OSS 120B → Together AI: TTFT ↓ 17%4d
MARKET REPORT

The European Inference Report

What is actually measurable in European AI inference today — and the size of the gap the registry says is coming.

Key findings
  • 2 of 6 measured providers qualify as European — EU-based or offering EU data residency.
  • Mistral is the strongest measured European path at 99.0.
  • The registry catalogues far more European providers than the measured set — the coverage gap is the story, and it closes one measurement credential at a time.

The measured European ranking

Ranked under the same methodology as the global table, restricted to providers that are EU-based or offer EU data residency: Mistral (99.0), Scaleway (85.6). Every number is measured from Falkenstein — the vantage a European workload actually experiences.

Sovereignty is not a static attribute but a supply chain: EU headquarters, EU processing, EU-owned infrastructure. The dossier of each provider carries its classification; this ranking only admits paths that satisfy the residency bar.

The gap between catalogued and measured

The registry tracks 9+ European serving options among 18 benchmark-declared providers, and the discovery engine catalogues European sovereign clouds, national hosts and specialist providers daily. Measurement follows credentials: as European providers land in the measured set, this report re-ranks automatically.

What this means for engineers
  • European teams can compare measured EU-resident paths against the global leaders on the same scale before committing — the premium, if any, is a number, not a guess.
  • For European providers: an unmeasured catalogue entry is invisible in procurement — measurement is distribution.
Dataset

Figures recompute from the live rolling window on every visit; the snapshot and versions above are the provenance of the regime that produced them. View the current benchmark →

Cite this researchInferenceBench (2026). The European Inference Report. InferenceBench Research.
← All research
Related research
The European Inference Report · InferenceBench