The Open-Source AI Stack
RSS
All models

Models · yi

Yi-34B-Chat

Open weights 01.AI · 2023-11-23 · Apache 2.0

Kai-Fu Lee's 01.AI released Yi-34B and the chat variant in late 2023, positioning a Chinese-developed open-weights model at the top of English and Chinese leaderboards. The Llama-compatible architecture meant existing Llama tooling worked unmodified, and the Apache 2.0 license cleared commercial use without an MAU cap.

Architecture

tokens in Embedding vocab not disclosed · yi tokenizer × N layers Grouped-Query Attention RoPE context 4,096 tokens Dense MLP SwiGLU activation (standard) 34B active params Output projection tokens out
Schema-generated from data/models.yaml. Every label is auditable against the model's sources.

Specs

Architecture
dense
Total params
34B
Active params
34B
Context window
4K tokens
Attention
gqa
Position encoding
rope
Pretraining tokens
3.0T
Post-training
sft
OSI-approved
yes
Data released
no
Training code
released

Benchmarks

Each score carries the date it was published; we never infer or interpolate missing scores.

Recommended use cases

  • bilingual English-Chinese chat
  • commercial use under Apache 2.0
  • Llama-tooling drop-in

Available quantizations

GGUF llama.cpp's container; the common local format, k-quants from Q2 to Q8. runs on llama.cpp, Ollama
AWQ Activation-aware 4-bit weight quantization for GPU serving. runs on vLLM, SGLang
GPTQ Post-training 4-bit weight quantization for GPU serving. runs on vLLM, SGLang, Transformers

Verified via the Hugging Face model tree ↗. Community quantizations change over time; the families shown are those with published weights at audit time.

Notable innovations

  • · Apache 2.0 at 34B scale from a Chinese lab
  • · 3T-token bilingual pretrain
  • · Llama-architecture-compatible

Lineage

Sibling to Yi-34B base; the Yi-34B-200K variant extends context to 200K with continued pretraining.

Sources