Models · Compare
Mistral Nemo 12B Instruct vs Claude 3.5 Sonnet
Rows highlighted in warm gray are where the models differ. Numbers carry their as-of date and primary source.
Specs
| Field | A: Mistral Nemo 12B Instruct | B: Claude 3.5 Sonnet |
|---|---|---|
| Released | 2024-07-18 | 2024-06-20 |
| Developer | Mistral AI | Anthropic |
| Openness | Open | Proprietary |
| License | Apache-2.0 | Proprietary |
| OSI-approved | yes | no |
| Data released | no | no |
| Training code | no | no |
| Architecture | dense | unknown |
| Total params | 12B | — |
| Active params | — | — |
| Experts | — | — |
| Context window | 131K | 200K |
| Attention | gqa | unknown |
| Position enc. | rope | unknown |
| Pretraining tokens | — | — |
| Post-training | sft, dpo | rlhf, constitutional |
| Training hardware | — | — |
| $/M input | — | — |
| $/M output | — | — |
| Output tok/sec | — | — |
Benchmarks
Missing scores render as not reported; never inferred. Bold highlights the leader per benchmark.
General reasoning
| MMLU | 68.0 2024-07-18 | — |
Code
Context · A
Co-developed with NVIDIA and released in July 2024 under Apache 2.0, Nemo positioned itself as a drop-in upgrade to Mistral 7B with a 128K context and quantisation-aware training that enables lossless FP8 inference. Ships with a new Tekken tokenizer trained on 100+ languages that is roughly 30% more efficient than Llama 3's tokenizer on code and major non-English languages.
Context · B
The first Claude release to beat its own larger sibling (Claude 3 Opus) on most benchmarks. Established Artifacts, driving a wave of code-and-canvas product copies.
Mistral Nemo 12B Instruct detail → · Claude 3.5 Sonnet detail →