Ornith 1.5 35B-A3B — VRAM requirements

Ornith AI · 35.95B params (3B active, mixture-of-experts) · up to 256K context

QuantizationVRAM at 4K contextVRAM at 256K context
FP16 / BF1682.9 GB95.0 GB
FP841.5 GB53.7 GB
INT841.5 GB53.7 GB
INT420.9 GB33.0 GB
Weights = params × bytes-per-parameter for the selected quantization.KV cache is always computed at FP16 and assumes batch size 1. A flat +15% is added on top for CUDA context/activation overhead — a rule of thumb, not a measured figure. Full methodology on the interactive calculator.

Compatible GPUs at 256K context

FP16 / BF16 (95.0 GB)

FP8 (53.7 GB)

INT8 (53.7 GB)

INT4 (33.0 GB)

Sparse mixture-of-experts (256 experts, top-8 routing per config.json). paramsB (35.95B) is the exact safetensors total from the Hugging Face API; activeParamsB (3B) is taken from the "A3B" designation in the official model name — Ornith's card does not state an exact activated-parameter figure in prose, so treat the 3B as the vendor's rounded label rather than a precise count. All 256 experts must be VRAM-resident, so the weights term uses the 35.95B total. maxContextLength 262,144 per the card (YaRN factor 4 extends to ~1M; not modelled here). Pulled 2026-09-19.

← Interactive VRAM calculator · All GPUs