Cost
$0.35
/ Mtok input
$0.85
/ Mtok output
Together AI · as of 2026-05-21
Architecture
data/models.yaml. Every label is auditable
against the model's sources.
Specs
- Architecture
- moe
- Total params
- 400B
- Active params
- 17B
- Experts
- 128 total · 1 active
- Context window
- not verified
- Attention
- gqa
- Position encoding
- rope-llama3
- Pretraining tokens
- 22.0T
- Training hardware
- H100
- Post-training
- sft, online-rl, dpo
- OSI-approved
- no
- Data released
- no
- Training code
- not released
Benchmarks
Each score carries the date it was published; we never infer or interpolate missing scores.
Math
| MATH | 88.9 | as of 2026-05-21 | source ↗ |
| AIME 2024 | 39.0 | as of 2026-05-21 | source ↗ |
| AIME 2025 | 19.3 | as of 2026-05-21 | source ↗ |
Held-out / arena
| LMArena Elo | 1417.0 | as of 2025-04-05 | source ↗ |
Available quantizations
GGUF llama.cpp's container; the common local format, k-quants from Q2 to Q8.
runs on llama.cpp, Ollama
FP8 8-bit float, frequently a native release on Hopper / Blackwell GPUs.
runs on vLLM, SGLang, TensorRT-LLM
Verified via the Hugging Face model tree ↗. Community quantizations change over time; the families shown are those with published weights at audit time.
Notable innovations
- · 128 routed experts plus shared expert
- · Native multimodal early fusion
- · Online RL post-training loop