The Open-Source AI Stack
RSS
All models

Models · Compare

Llama 2 70B Chat vs GPT-4

Rows highlighted in warm gray are where the models differ. Numbers carry their as-of date and primary source.

Specs

Field A: Llama 2 70B Chat B: GPT-4
Released 2023-07-18
Developer MetaOpenAI
Openness Source-availableProprietary
License Llama 2 Community LicenseProprietary
OSI-approved nono
Data released nono
Training code nono
Architecture denseunknown
Total params 70B
Active params
Experts
Context window
Attention gqaunknown
Position enc. ropeunknown
Pretraining tokens
Post-training sft, rlhfrlhf
Training hardware A100
$/M input $30.00
$/M output $60.00
Output tok/sec 28.6

Benchmarks

Missing scores render as not reported; never inferred. Bold highlights the leader per benchmark.

General reasoning

Code

Context · A

The first Meta-blessed commercial-use open-weights release. Llama 2's community license permitted commercial use under a 700M-MAU cap, opening the door to a year of derivatives that defined what open-weights deployment looked like.

Context · B

The frontier reference point for the 2023-2024 open-weights catch-up race. Architecture and training data not disclosed.

Llama 2 70B Chat detail → · GPT-4 detail →