The Open-Source AI Stack
RSS
All models

Models · Compare

Llama 3.1 8B Instruct vs Claude 3.5 Sonnet

Rows highlighted in warm gray are where the models differ. Numbers carry their as-of date and primary source.

Specs

Field A: Llama 3.1 8B Instruct B: Claude 3.5 Sonnet
Released 2024-07-232024-06-20
Developer MetaAnthropic
Openness Source-availableProprietary
License Llama 3.1 Community LicenseProprietary
OSI-approved nono
Data released nono
Training code nono
Architecture denseunknown
Total params 8.0B
Active params
Experts
Context window 131K200K
Attention gqaunknown
Position enc. rope-llama3unknown
Pretraining tokens
Post-training sft, dporlhf, constitutional
Training hardware H100
$/M input
$/M output
Output tok/sec

Benchmarks

Missing scores render as not reported; never inferred. Bold highlights the leader per benchmark.

General reasoning

GPQA-Diamond 30.4 2024-07-23

Code

Context · A

Extended the 3 series to 128K context via continued pretraining and tool-use post-training. The 405B sibling launched the same day was the first open-weights model at GPT-4-class scale.

Context · B

The first Claude release to beat its own larger sibling (Claude 3 Opus) on most benchmarks. Established Artifacts, driving a wave of code-and-canvas product copies.

Llama 3.1 8B Instruct detail → · Claude 3.5 Sonnet detail →