The Open-Source AI Stack
RSS
All models

Models · Compare

Mistral Nemo 12B Instruct vs Claude 3.5 Sonnet

Rows highlighted in warm gray are where the models differ. Numbers carry their as-of date and primary source.

Specs

Field A: Mistral Nemo 12B Instruct B: Claude 3.5 Sonnet
Released 2024-07-182024-06-20
Developer Mistral AIAnthropic
Openness OpenProprietary
License Apache-2.0Proprietary
OSI-approved yesno
Data released nono
Training code nono
Architecture denseunknown
Total params 12B
Active params
Experts
Context window 131K200K
Attention gqaunknown
Position enc. ropeunknown
Pretraining tokens
Post-training sft, dporlhf, constitutional
Training hardware
$/M input
$/M output
Output tok/sec

Benchmarks

Missing scores render as not reported; never inferred. Bold highlights the leader per benchmark.

General reasoning

MMLU 68.0 2024-07-18

Code

Context · A

Co-developed with NVIDIA and released in July 2024 under Apache 2.0, Nemo positioned itself as a drop-in upgrade to Mistral 7B with a 128K context and quantisation-aware training that enables lossless FP8 inference. Ships with a new Tekken tokenizer trained on 100+ languages that is roughly 30% more efficient than Llama 3's tokenizer on code and major non-English languages.

Context · B

The first Claude release to beat its own larger sibling (Claude 3 Opus) on most benchmarks. Established Artifacts, driving a wave of code-and-canvas product copies.

Mistral Nemo 12B Instruct detail → · Claude 3.5 Sonnet detail →