The Open-Source AI Stack
RSS
All models

Models · falcon

Falcon 180B Chat

Source-available Technology Innovation Institute · 2023-09-04 · Falcon-180B TII License

TII's Falcon 180B was, at release, the largest openly available language model weights, fine-tuned on Ultrachat, Platypus, and Airoboros for the Chat variant. Trained on RefinedWeb across up to 4,096 A100 40GB GPUs on AWS SageMaker. The TII Falcon License is source-available with an acceptable-use policy attached.

Architecture

tokens in Embedding vocab 65,024 · falcon tokenizer × 80 layers Multi-Query Attention RoPE context 2,048 tokens Dense MLP SwiGLU activation (standard) 180B active params Output projection tokens out
Schema-generated from data/models.yaml. Every label is auditable against the model's sources.

Specs

Architecture
dense
Total params
180B
Active params
180B
Context window
2K tokens
Attention
mqa
Position encoding
rope
Training hardware
A100 40GB
Post-training
sft
OSI-approved
no
Data released
no
Training code
not released

Recommended use cases

  • large-scale generation under TII license
  • research deployments with 8x A100 80GB

Available quantizations

GGUF llama.cpp's container; the common local format, k-quants from Q2 to Q8. runs on llama.cpp, Ollama
AWQ Activation-aware 4-bit weight quantization for GPU serving. runs on vLLM, SGLang
GPTQ Post-training 4-bit weight quantization for GPU serving. runs on vLLM, SGLang, Transformers

Verified via the Hugging Face model tree ↗. Community quantizations change over time; the families shown are those with published weights at audit time.

Notable innovations

  • · Largest openly available weights at 2023 release
  • · Multi-query attention with parallel attention/MLP blocks
  • · RefinedWeb pretraining corpus

Known limitations

  • · TII Falcon License is source-available, not OSI-approved. source ↗
  • · 2,048-token context is narrow by 2024-onward standards. source ↗

Lineage

Chat fine-tune of Falcon-180B base; descends from the earlier Falcon-7B and Falcon-40B releases.

Sources