Models · Compare
OLMo 2 7B Instruct vs OpenAI o1
Rows highlighted in warm gray are where the models differ. Numbers carry their as-of date and primary source.
Specs
| Field | A: OLMo 2 7B Instruct | B: OpenAI o1 |
|---|---|---|
| Released | 2024-11-26 | — |
| Developer | AI2 | OpenAI |
| Openness | Open | Proprietary |
| License | Apache-2.0 | Proprietary |
| OSI-approved | yes | no |
| Data released | yes | no |
| Training code | yes | no |
| Architecture | dense | unknown |
| Total params | 7B | — |
| Active params | — | — |
| Experts | — | — |
| Context window | — | — |
| Attention | mha | unknown |
| Position enc. | rope | unknown |
| Pretraining tokens | — | — |
| Post-training | sft, dpo | rlhf |
| Training hardware | H100 | — |
| $/M input | — | $15.00 |
| $/M output | — | $60.00 |
| Output tok/sec | — | 75.8 |
Benchmarks
Missing scores render as not reported; never inferred. Bold highlights the leader per benchmark.
General reasoning
| MMLU | 61.3 2024-12-02 | — |
| MMLU-Pro | — | 84.1 2026-05-21 |
| GPQA-Diamond | — | 77.3 2024-12-05 |
Code
| LiveCodeBench | — | 67.9 2026-05-21 |
Math
| MATH | — | 97.0 2026-05-21 |
| AIME 2024 | — | 83.3 2024-12-05 |
Context · A
The only major open-weights release that meets the strictest reading of OSAID: weights, training data (Dolma), training code (OLMo trainer), and training logs (WandB). Reference for what "fully open" can mean in 2024.
Context · B
The first publicly available frontier reasoning model. Trained to spend extra inference compute on a "private chain of thought" before answering, setting the template the open community would chase with R1.