PERFORMANCELlama 3.3 70B → Scaleway: throughput ↑ 53%5hPERFORMANCEGLM-5.2 → Scaleway: TTFT ↓ 30%5hPERFORMANCEMistral Medium 3.5 → Scaleway: throughput ↑ 22%5hPERFORMANCEQwen3-235B → Scaleway: throughput ↑ 67%5hPERFORMANCEGPT-5.6 Sol → OpenAI: TTFT ↓ 22%5hPERFORMANCEMistral Large 3 → Mistral AI: TTFT ↓ 21%5hPERFORMANCEGPT-5.6 Luna → OpenAI: throughput ↑ 21%5hPERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↑ 147%5hPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↓ 71%5hPERFORMANCEGPT-OSS 120B → Scaleway: TTFT ↓ 46%5hPERFORMANCEGPT-OSS 120B → Together AI: TTFT ↓ 40%5hPERFORMANCEKimi K3 → Together AI: TTFT ↓ 20%5hPERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↑ 36%30hPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↓ 19%30hPERFORMANCEQwen3-235B → Scaleway: throughput ↑ 19%2dPERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↑ 58%2dPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↑ 21%2dPERFORMANCEGPT-5.6 Sol → OpenAI: throughput ↑ 16%2dPERFORMANCEGPT-OSS 120B → Together AI: TTFT ↑ 22%2dPERFORMANCEKimi K3 → Together AI: throughput ↑ 62%2dPERFORMANCEKimi K3 → Together AI: TTFT ↓ 42%2dPERFORMANCEQwen3-235B → Scaleway: throughput ↑ 30%3dPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↓ 56%3dPERFORMANCELlama 3.3 70B → Scaleway: throughput ↑ 34%3dPERFORMANCELlama 3.3 70B → Scaleway: TTFT ↓ 26%3dPERFORMANCEKimi K3 → Together AI: throughput ↑ 128%3dPERFORMANCEGPT-OSS 120B → Together AI: throughput ↑ 29%3dPERFORMANCEGPT-OSS 120B → Together AI: TTFT ↓ 21%3dPERFORMANCEGPT-OSS 20B → Groq: TTFT ↑ 66%3dPERFORMANCEGLM-5.2 → Together AI: throughput ↑ 47%3dPERFORMANCEMistral Medium 3.5 → Scaleway: TTFT ↑ 18%4dPERFORMANCEGLM-5.2 → Scaleway: throughput ↓ 27%4dPERFORMANCEGLM-5.2 → Scaleway: TTFT ↑ 49%4dPERFORMANCEDeepSeek V4 Flash → Scaleway: throughput ↓ 71%4dPERFORMANCEDeepSeek V4 Flash → Scaleway: TTFT ↑ 190%4dPERFORMANCEGPT-5.6 Luna → OpenAI: throughput ↓ 23%4dPERFORMANCELlama 3.3 70B → Scaleway: TTFT ↑ 60%4dPERFORMANCEGLM-5.2 → Together AI: TTFT ↓ 25%4dPERFORMANCEGPT-OSS 120B → Together AI: throughput ↓ 16%4dPERFORMANCEGPT-OSS 120B → Together AI: TTFT ↓ 17%4d

Together AI — AI inference benchmarks

US · serverless · 3 benchmarked models · 1 region
#4 GLOBALAdd to compare
Overall91.6Rel.100.0%Tools100.0%JSON100.0%TTFT309 msP952426 msTok/s174Price$1.40 / $4.40Δ30d↑ 16.5● last run 4h ago · 19 runs in 24h

Head-to-head: vs Cerebras · vs Groq · vs Scaleway

Provider vs market

Percentile across 6 ranked providers
Reliability 100.0%P100
Tools 100.0%P100
Structured 100.0%P100
TTFT 309 msP50
Throughput 174 tok/sP67
Cost $4.40P50

Price vs performance

Together AI highlighted vs peers
889296100$4.37$8.74$13.10$17.47Output price $/M →Score ↑Cerebras — $0.75/M out · score 99.0Mistral — $4.50/M out · score 99.0Groq — $0.45/M out · score 95.6Together — $4.40/M out · score 91.6TogetherOpenAI — $15.60/M out · score 88.4Scaleway — $1.81/M out · score 85.6

30-day trend

Measured daily series
Score91.6
TTFT201 ms
Tools100.0%
Reliability100.0%
Price$0.60

Key positioning

Derived from benchmark percentiles
Strengths
  • Reliability (P100)
  • Tools (P100)
  • Structured (P100)
Weaknesses
  • No P40-or-below metric
Best suited for

Together AI in the registry

  • HeadquartersUS
  • API protocolsopenai chat completions
  • Catalogued endpoints1
  • Websitewww.together.ai
  • Last verified2026-10-22

All providers · How we benchmark