InferenceBench
Europe
Providers
Models
Research
Partners
Data
Methodology
Search
/
PERFORMANCE
Llama 3.3 70B → Scaleway: throughput ↑ 53%
6h
PERFORMANCE
GLM-5.2 → Scaleway: TTFT ↓ 30%
6h
PERFORMANCE
Mistral Medium 3.5 → Scaleway: throughput ↑ 22%
6h
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 67%
6h
PERFORMANCE
GPT-5.6 Sol → OpenAI: TTFT ↓ 22%
6h
PERFORMANCE
Mistral Large 3 → Mistral AI: TTFT ↓ 21%
6h
PERFORMANCE
GPT-5.6 Luna → OpenAI: throughput ↑ 21%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 147%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 71%
6h
PERFORMANCE
GPT-OSS 120B → Scaleway: TTFT ↓ 46%
6h
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 40%
6h
PERFORMANCE
Kimi K3 → Together AI: TTFT ↓ 20%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 36%
30h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 19%
30h
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 19%
2d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 58%
2d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↑ 21%
2d
PERFORMANCE
GPT-5.6 Sol → OpenAI: throughput ↑ 16%
2d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↑ 22%
2d
PERFORMANCE
Kimi K3 → Together AI: throughput ↑ 62%
2d
PERFORMANCE
Kimi K3 → Together AI: TTFT ↓ 42%
2d
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 30%
3d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 56%
3d
PERFORMANCE
Llama 3.3 70B → Scaleway: throughput ↑ 34%
3d
PERFORMANCE
Llama 3.3 70B → Scaleway: TTFT ↓ 26%
3d
PERFORMANCE
Kimi K3 → Together AI: throughput ↑ 128%
3d
PERFORMANCE
GPT-OSS 120B → Together AI: throughput ↑ 29%
3d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 21%
3d
PERFORMANCE
GPT-OSS 20B → Groq: TTFT ↑ 66%
3d
PERFORMANCE
GLM-5.2 → Together AI: throughput ↑ 47%
3d
PERFORMANCE
Mistral Medium 3.5 → Scaleway: TTFT ↑ 18%
4d
PERFORMANCE
GLM-5.2 → Scaleway: throughput ↓ 27%
4d
PERFORMANCE
GLM-5.2 → Scaleway: TTFT ↑ 49%
4d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↓ 71%
4d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↑ 190%
4d
PERFORMANCE
GPT-5.6 Luna → OpenAI: throughput ↓ 23%
4d
PERFORMANCE
Llama 3.3 70B → Scaleway: TTFT ↑ 60%
4d
PERFORMANCE
GLM-5.2 → Together AI: TTFT ↓ 25%
4d
PERFORMANCE
GPT-OSS 120B → Together AI: throughput ↓ 16%
4d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 17%
4d
PERFORMANCE
Llama 3.3 70B → Scaleway: throughput ↑ 53%
6h
PERFORMANCE
GLM-5.2 → Scaleway: TTFT ↓ 30%
6h
PERFORMANCE
Mistral Medium 3.5 → Scaleway: throughput ↑ 22%
6h
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 67%
6h
PERFORMANCE
GPT-5.6 Sol → OpenAI: TTFT ↓ 22%
6h
PERFORMANCE
Mistral Large 3 → Mistral AI: TTFT ↓ 21%
6h
PERFORMANCE
GPT-5.6 Luna → OpenAI: throughput ↑ 21%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 147%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 71%
6h
PERFORMANCE
GPT-OSS 120B → Scaleway: TTFT ↓ 46%
6h
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 40%
6h
PERFORMANCE
Kimi K3 → Together AI: TTFT ↓ 20%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 36%
30h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 19%
30h
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 19%
2d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 58%
2d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↑ 21%
2d
PERFORMANCE
GPT-5.6 Sol → OpenAI: throughput ↑ 16%
2d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↑ 22%
2d
PERFORMANCE
Kimi K3 → Together AI: throughput ↑ 62%
2d
PERFORMANCE
Kimi K3 → Together AI: TTFT ↓ 42%
2d
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 30%
3d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 56%
3d
PERFORMANCE
Llama 3.3 70B → Scaleway: throughput ↑ 34%
3d
PERFORMANCE
Llama 3.3 70B → Scaleway: TTFT ↓ 26%
3d
PERFORMANCE
Kimi K3 → Together AI: throughput ↑ 128%
3d
PERFORMANCE
GPT-OSS 120B → Together AI: throughput ↑ 29%
3d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 21%
3d
PERFORMANCE
GPT-OSS 20B → Groq: TTFT ↑ 66%
3d
PERFORMANCE
GLM-5.2 → Together AI: throughput ↑ 47%
3d
PERFORMANCE
Mistral Medium 3.5 → Scaleway: TTFT ↑ 18%
4d
PERFORMANCE
GLM-5.2 → Scaleway: throughput ↓ 27%
4d
PERFORMANCE
GLM-5.2 → Scaleway: TTFT ↑ 49%
4d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↓ 71%
4d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↑ 190%
4d
PERFORMANCE
GPT-5.6 Luna → OpenAI: throughput ↓ 23%
4d
PERFORMANCE
Llama 3.3 70B → Scaleway: TTFT ↑ 60%
4d
PERFORMANCE
GLM-5.2 → Together AI: TTFT ↓ 25%
4d
PERFORMANCE
GPT-OSS 120B → Together AI: throughput ↓ 16%
4d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 17%
4d
Mistral Medium 3.5
4 providers · 128B dense · 256k context · 2 regions ·
all models →
Providers
Performance
Price
History
Provider
$ In / M
$ Out / M
Score per $
Tok/s per $
Δ30d
Mistral
$1.50
$7.50
12 pts/$
19
—
Scaleway
$1.72
$8.60
10 pts/$
8
↑ 1.0
Mistral Medium 3.5 inference benchmark: fastest & cheapest providers · InferenceBench