The Open-Source AI Stack
RSS
All models

Models · Compare

GPT-4 vs Llama 2 70B Chat

Rows highlighted in warm gray are where the models differ. Numbers carry their as-of date and primary source.

Specs

Field A: GPT-4 B: Llama 2 70B Chat
Released 2023-07-18
Developer OpenAIMeta
Openness ProprietarySource-available
License ProprietaryLlama 2 Community License
OSI-approved nono
Data released nono
Training code nono
Architecture unknowndense
Total params 70B
Active params
Experts
Context window
Attention unknowngqa
Position enc. unknownrope
Pretraining tokens
Post-training rlhfsft, rlhf
Training hardware A100
$/M input $30.00
$/M output $60.00
Output tok/sec 28.6

Benchmarks

Missing scores render as not reported; never inferred. Bold highlights the leader per benchmark.

General reasoning

Code

Context · A

The frontier reference point for the 2023-2024 open-weights catch-up race. Architecture and training data not disclosed.

Context · B

The first Meta-blessed commercial-use open-weights release. Llama 2's community license permitted commercial use under a 700M-MAU cap, opening the door to a year of derivatives that defined what open-weights deployment looked like.

GPT-4 detail → · Llama 2 70B Chat detail →