Ornith 1.5 35B-A3B — VRAM requirements
Ornith AI · 35.95B params (3B active, mixture-of-experts) · up to 256K context
| Quantization | VRAM at 4K context | VRAM at 256K context |
|---|---|---|
| FP16 / BF16 | 82.9 GB | 95.0 GB |
| FP8 | 41.5 GB | 53.7 GB |
| INT8 | 41.5 GB | 53.7 GB |
| INT4 | 20.9 GB | 33.0 GB |
Weights = params × bytes-per-parameter for the selected quantization.KV cache is always computed at FP16 and assumes batch size 1. A flat +15% is added on top for CUDA context/activation overhead — a rule of thumb, not a measured figure. Full methodology on the interactive calculator.
Compatible GPUs at 256K context
FP16 / BF16 (95.0 GB)
FP8 (53.7 GB)
INT8 (53.7 GB)
INT4 (33.0 GB)
Sparse mixture-of-experts (256 experts, top-8 routing per config.json). paramsB (35.95B) is the exact safetensors total from the Hugging Face API; activeParamsB (3B) is taken from the "A3B" designation in the official model name — Ornith's card does not state an exact activated-parameter figure in prose, so treat the 3B as the vendor's rounded label rather than a precise count. All 256 experts must be VRAM-resident, so the weights term uses the 35.95B total. maxContextLength 262,144 per the card (YaRN factor 4 extends to ~1M; not modelled here). Pulled 2026-09-19.