InferenceBench
Europe
Providers
Models
Research
Partners
Data
Methodology
Search
/
PERFORMANCE
Llama 3.3 70B → Scaleway: throughput ↑ 53%
6h
PERFORMANCE
GLM-5.2 → Scaleway: TTFT ↓ 30%
6h
PERFORMANCE
Mistral Medium 3.5 → Scaleway: throughput ↑ 22%
6h
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 67%
6h
PERFORMANCE
GPT-5.6 Sol → OpenAI: TTFT ↓ 22%
6h
PERFORMANCE
Mistral Large 3 → Mistral AI: TTFT ↓ 21%
6h
PERFORMANCE
GPT-5.6 Luna → OpenAI: throughput ↑ 21%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 147%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 71%
6h
PERFORMANCE
GPT-OSS 120B → Scaleway: TTFT ↓ 46%
6h
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 40%
6h
PERFORMANCE
Kimi K3 → Together AI: TTFT ↓ 20%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 36%
30h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 19%
30h
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 19%
2d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 58%
2d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↑ 21%
2d
PERFORMANCE
GPT-5.6 Sol → OpenAI: throughput ↑ 16%
2d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↑ 22%
2d
PERFORMANCE
Kimi K3 → Together AI: throughput ↑ 62%
2d
PERFORMANCE
Kimi K3 → Together AI: TTFT ↓ 42%
2d
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 30%
3d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 56%
3d
PERFORMANCE
Llama 3.3 70B → Scaleway: throughput ↑ 34%
3d
PERFORMANCE
Llama 3.3 70B → Scaleway: TTFT ↓ 26%
3d
PERFORMANCE
Kimi K3 → Together AI: throughput ↑ 128%
3d
PERFORMANCE
GPT-OSS 120B → Together AI: throughput ↑ 29%
3d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 21%
3d
PERFORMANCE
GPT-OSS 20B → Groq: TTFT ↑ 66%
3d
PERFORMANCE
GLM-5.2 → Together AI: throughput ↑ 47%
3d
PERFORMANCE
Mistral Medium 3.5 → Scaleway: TTFT ↑ 18%
4d
PERFORMANCE
GLM-5.2 → Scaleway: throughput ↓ 27%
4d
PERFORMANCE
GLM-5.2 → Scaleway: TTFT ↑ 49%
4d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↓ 71%
4d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↑ 190%
4d
PERFORMANCE
GPT-5.6 Luna → OpenAI: throughput ↓ 23%
4d
PERFORMANCE
Llama 3.3 70B → Scaleway: TTFT ↑ 60%
4d
PERFORMANCE
GLM-5.2 → Together AI: TTFT ↓ 25%
4d
PERFORMANCE
GPT-OSS 120B → Together AI: throughput ↓ 16%
4d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 17%
4d
PERFORMANCE
Llama 3.3 70B → Scaleway: throughput ↑ 53%
6h
PERFORMANCE
GLM-5.2 → Scaleway: TTFT ↓ 30%
6h
PERFORMANCE
Mistral Medium 3.5 → Scaleway: throughput ↑ 22%
6h
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 67%
6h
PERFORMANCE
GPT-5.6 Sol → OpenAI: TTFT ↓ 22%
6h
PERFORMANCE
Mistral Large 3 → Mistral AI: TTFT ↓ 21%
6h
PERFORMANCE
GPT-5.6 Luna → OpenAI: throughput ↑ 21%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 147%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 71%
6h
PERFORMANCE
GPT-OSS 120B → Scaleway: TTFT ↓ 46%
6h
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 40%
6h
PERFORMANCE
Kimi K3 → Together AI: TTFT ↓ 20%
6h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 36%
30h
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 19%
30h
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 19%
2d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↑ 58%
2d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↑ 21%
2d
PERFORMANCE
GPT-5.6 Sol → OpenAI: throughput ↑ 16%
2d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↑ 22%
2d
PERFORMANCE
Kimi K3 → Together AI: throughput ↑ 62%
2d
PERFORMANCE
Kimi K3 → Together AI: TTFT ↓ 42%
2d
PERFORMANCE
Qwen3-235B → Scaleway: throughput ↑ 30%
3d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↓ 56%
3d
PERFORMANCE
Llama 3.3 70B → Scaleway: throughput ↑ 34%
3d
PERFORMANCE
Llama 3.3 70B → Scaleway: TTFT ↓ 26%
3d
PERFORMANCE
Kimi K3 → Together AI: throughput ↑ 128%
3d
PERFORMANCE
GPT-OSS 120B → Together AI: throughput ↑ 29%
3d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 21%
3d
PERFORMANCE
GPT-OSS 20B → Groq: TTFT ↑ 66%
3d
PERFORMANCE
GLM-5.2 → Together AI: throughput ↑ 47%
3d
PERFORMANCE
Mistral Medium 3.5 → Scaleway: TTFT ↑ 18%
4d
PERFORMANCE
GLM-5.2 → Scaleway: throughput ↓ 27%
4d
PERFORMANCE
GLM-5.2 → Scaleway: TTFT ↑ 49%
4d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: throughput ↓ 71%
4d
PERFORMANCE
DeepSeek V4 Flash → Scaleway: TTFT ↑ 190%
4d
PERFORMANCE
GPT-5.6 Luna → OpenAI: throughput ↓ 23%
4d
PERFORMANCE
Llama 3.3 70B → Scaleway: TTFT ↑ 60%
4d
PERFORMANCE
GLM-5.2 → Together AI: TTFT ↓ 25%
4d
PERFORMANCE
GPT-OSS 120B → Together AI: throughput ↓ 16%
4d
PERFORMANCE
GPT-OSS 120B → Together AI: TTFT ↓ 17%
4d
GPT-OSS 20B
on
Groq
#1 of 1 providers for GPT-OSS 20B · #1 of 2 models on Groq · US
Compare with other providers
Score
99.8
Rel.
100.0%
Tools
100.0%
JSON
100.0%
TTFT
274 ms
P95
432 ms
Tok/s
894
Price
$0.075 / $0.30
Ctx
128k
217 results · last 89m ago
GPT-OSS 20B on other providers
Provider
Score
TTFT
Tok/s
$ Out
Groq
THIS PAGE
99.8
274 ms
894
$0.30
Other models on Groq
Model
Score
TTFT
$ Out
GPT-OSS 20B
THIS PAGE
94.1
274 ms
$0.30
GPT-OSS 120B
90.9
291 ms
$0.60