Models · Compare
Llama 3 8B Instruct vs GPT-4 Turbo
Rows highlighted in warm gray are where the models differ. Numbers carry their as-of date and primary source.
Specs
| Field | A: Llama 3 8B Instruct | B: GPT-4 Turbo |
|---|---|---|
| Released | 2024-04-18 | 2024-04-09 |
| Developer | Meta | OpenAI |
| Openness | Source-available | Proprietary |
| License | Llama 3 Community License | Proprietary |
| OSI-approved | no | no |
| Data released | no | no |
| Training code | no | no |
| Architecture | dense | unknown |
| Total params | 8B | — |
| Active params | — | — |
| Experts | — | — |
| Context window | 8K | 128K |
| Attention | gqa | unknown |
| Position enc. | rope-llama3 | unknown |
| Pretraining tokens | 15.0T | — |
| Post-training | sft, dpo, rejection-sampling | rlhf |
| Training hardware | H100 | — |
| $/M input | — | $10.00 |
| $/M output | — | $30.00 |
| Output tok/sec | — | 27.8 |
Benchmarks
Missing scores render as not reported; never inferred. Bold highlights the leader per benchmark.
General reasoning
| MMLU-Pro | — | 69.4 2026-05-21 |
Code
| LiveCodeBench | — | 29.1 2026-05-21 |
Math
| MATH | — | 73.7 2026-05-21 |
| AIME 2024 | — | 15.0 2026-05-21 |
Context · A
The 15T-token pretrain and a 4x larger 128K-token vocab were the headline changes. The 8B class became the new local-deployment default, displacing Mistral 7B.
Context · B
Announced at OpenAI DevDay on November 6, 2023 as a 128K-context, cheaper successor to the original GPT-4 endpoint. The gpt-4-turbo-2024-04-09 revision shipped as the general-availability version with vision support and a knowledge cutoff through December 2023.