The Open-Source AI Stack
RSS

The Stack · Sovereignty and Decentralization Primitives · Open source

Prime Intellect INTELLECT-1

10B-parameter model trained across distributed compute via the PRIME framework; first public proof that decentralized frontier-ish training is feasible.

Apache 2.0 · research · Project site →

INTELLECT-1 is a 10B-parameter language model that Prime Intellect trained across distributed compute spanning multiple continents, released November 2024. Apache 2.0. The training run used Prime Intellect's PRIME framework with bandwidth- efficient gradient synchronization to make training over commodity internet links practical at this scale. The model itself is open-weights with full training methodology published. INTELLECT-1 matters because it is the first reproducible public proof that decentralized pretraining of a 10B+ model is feasible at all. Before this, "decentralized training" was mostly theoretical. INTELLECT-1 was followed by INTELLECT-2 (32B with reinforcement-learning post-training) in 2025. Compared to siblings: Templar Covenant-72B (Bittensor subnet, larger model, different incentive design), Pluralis and Gensyn (earlier-stage research bets with distinct technical approaches), Nous Research's DisTrO (the bandwidth-efficient optimizer family used by several of these projects). Production-readiness: the model itself is shipped and usable; the methodology is reproducible by anyone with similar compute partners; capability remains a generation behind centralized frontier training at iso-cost. The interesting role for INTELLECT-1 is not to compete with frontier labs on raw capability but to show that an alternative training topology is technically possible. Strategic significance for the sovereignty conversation: a community that wants a model independent of any hyperscaler relationship now has a concrete template to follow.

Sources

Want a follow-up? Ask the chat about Prime Intellect INTELLECT-1 in context. It will compare to siblings at the same layer and ground every claim in the wiki.

Other projects at the Sovereignty and Decentralization Primitives layer

5 siblings · ordered open first