Specs
- Memory
- 128 GB Unified LPDDR5X
- Bandwidth
- 256 GB/s
- NPU
- 50 INT8 TOPS
- Power
- 120 W
- Form factor
- soc
- Interconnect
- none
- Released
- 2025-01
What it runs (single unit, Q4_K_M, 4K context)
| Model | Fits? | Decode ceiling |
|---|---|---|
| Llama 3.1 8B Instruct | yes | ~51 tok/s |
| Llama 3.3 70B Instruct | yes | ~6.3 tok/s |
| Qwen 2.5 72B Instruct | yes | ~6.1 tok/s |
| DeepSeek-V3 | no | — |
Ceiling is the theoretical rooflineruntimeA performance model that bounds throughput by either compute or memory bandwidth, whichever is the limiting resource for an operation's arithmetic intensity. Open full entry ; open the explorer to set quant, context, and runtime and see the realistic range.