Which GPUs does vLLM support?
vLLM 0.30.0: 40 of the 65 GPUs tracked here are supported, from the library's own requirements. Checked 2026-09-27.
The rule
- NVIDIA: compute capability 7.5 or higher.
- AMD: gfx90a, gfx942, gfx950, gfx1100, gfx1101, gfx1150, gfx1151, gfx1200, gfx1201. ROCm 6.3 or newer (MI350 needs ROCm 7.0+, Ryzen AI MAX / AI 300 need 7.0.2+). Pre-built wheels for ROCm 7.0 and 7.2.1.
- Intel: supported. XPU backend: Intel Data Center GPU and Arc GPUs.
Requirements as stated in vLLM's own installation docs at the v0.30.0 tag. The NVIDIA minimum has been compute capability 7.5 since at least v0.20.0 (checked at v0.20.0, 0.24.0, 0.26.0-0.29.0), so the V100 (7.0) is not supported. The AMD list is the docs' "GPU:" requirement line: MI200s (gfx90a), MI300 (gfx942), MI350 (gfx950), Radeon RX 7900 series (gfx1100/1101), Radeon RX 9000 series (gfx1200/1201), Ryzen AI MAX / AI 300 (gfx1151/1150).
Supported (40)
| GPU | Vendor | Target | Details |
|---|---|---|---|
| B300 (Blackwell Ultra) | NVIDIA | 10.3 | |
| DGX Spark | NVIDIA | 12.1 | |
| RTX 5060 Ti 16GB | NVIDIA | 12.0 | |
| RTX 5090 | NVIDIA | 12.0 | |
| RTX PRO 6000 Blackwell | NVIDIA | 12.0 | |
| B200 | NVIDIA | 10.0 | |
| H200 SXM 141GB | NVIDIA | 9.0 | |
| L40S | NVIDIA | 8.9 | |
| RTX 4060 Ti 16GB | NVIDIA | 8.9 | |
| H100 SXM5 80GB | NVIDIA | 9.0 | |
| RTX 4090 | NVIDIA | 8.9 | |
| RTX 6000 Ada Generation | NVIDIA | 8.9 | |
| RTX 3060 12GB | NVIDIA | 8.6 | |
| A100 SXM4 80GB | NVIDIA | 8.0 | |
| RTX 3090 | NVIDIA | 8.6 | |
| T4 | NVIDIA | 7.5 | |
| TITAN RTX | NVIDIA | 7.5 | |
| Instinct MI350X | AMD | gfx950 | |
| Instinct MI355X | AMD | gfx950 | |
| Radeon AI PRO R9700 | AMD | gfx1201 | |
| Radeon RX 9060 XT (16GB) | AMD | gfx1200 | |
| Radeon RX 9060 XT (8GB) | AMD | gfx1200 | |
| Radeon RX 9070 | AMD | gfx1201 | |
| Radeon RX 9070 XT | AMD | gfx1201 | |
| Ryzen AI Max+ 395 | AMD | gfx1151 | |
| Instinct MI325X | AMD | gfx942 | |
| Instinct MI300A | AMD | gfx942 | |
| Instinct MI300X | AMD | gfx942 | |
| Radeon RX 7700 XT | AMD | gfx1101 | |
| Radeon RX 7800 XT | AMD | gfx1101 | |
| Radeon RX 7900 GRE | AMD | gfx1100 | |
| Instinct MI210 | AMD | gfx90a | |
| Radeon RX 7900 XT | AMD | gfx1100 | |
| Radeon RX 7900 XTX | AMD | gfx1100 | |
| Instinct MI250X | AMD | gfx90a | |
| Arc B580 | Intel | — | XPU backend: Intel Data Center GPU and Arc GPUs. |
| Data Center GPU Max 1550 | Intel | — | XPU backend: Intel Data Center GPU and Arc GPUs. |
| Arc A380 | Intel | — | XPU backend: Intel Data Center GPU and Arc GPUs. |
| Arc A750 | Intel | — | XPU backend: Intel Data Center GPU and Arc GPUs. |
| Arc A770 (16GB) | Intel | — | XPU backend: Intel Data Center GPU and Arc GPUs. |
Not supported (24)
| GPU | Vendor | Target | Details |
|---|---|---|---|
| GTX 1080 Ti | NVIDIA | 6.1 | needs compute capability 7.5+ |
| TITAN V | NVIDIA | 7.0 | needs compute capability 7.5+ |
| V100 SXM2 32GB | NVIDIA | 7.0 | needs compute capability 7.5+ |
| P100 SXM2 16GB | NVIDIA | 6.0 | needs compute capability 7.5+ |
| Tesla P40 | NVIDIA | 6.1 | needs compute capability 7.5+ |
| TITAN X (Pascal) | NVIDIA | 6.1 | needs compute capability 7.5+ |
| M40 24GB | NVIDIA | 5.2 | needs compute capability 7.5+ |
| K80 | NVIDIA | 3.7 | needs compute capability 7.5+ |
| Radeon RX 7600 XT | AMD | gfx1102 | |
| Radeon RX 6650 XT | AMD | gfx1032 | |
| Radeon RX 6750 XT | AMD | gfx1031 | |
| Radeon RX 6950 XT | AMD | gfx1030 | |
| Radeon RX 6600 | AMD | gfx1032 | |
| Radeon RX 6700 XT | AMD | gfx1031 | |
| Instinct MI100 | AMD | gfx908 | |
| Radeon RX 6800 | AMD | gfx1030 | |
| Radeon RX 6800 XT | AMD | gfx1030 | |
| Radeon RX 6900 XT | AMD | gfx1030 | |
| Radeon VII | AMD | gfx906 | |
| Radeon Instinct MI50 | AMD | gfx906 | |
| Radeon Instinct MI60 | AMD | gfx906 | |
| Radeon Instinct MI25 | AMD | gfx900 | |
| Radeon Instinct MI6 | AMD | gfx803 | |
| Radeon Instinct MI8 | AMD | gfx803 |
Not enough data (1)
| GPU | Vendor | Target | Details |
|---|---|---|---|
| Instinct MI455X | AMD | — | gfx target not recorded |
Sources: github.com/vllm-project/vllm/blob/v0.30.0/docs/getting_started/installation/gpu.cuda.inc.md, github.com/vllm-project/vllm/blob/v0.30.0/docs/getting_started/installation/gpu.rocm.inc.md, github.com/vllm-project/vllm/blob/v0.30.0/docs/getting_started/installation/gpu.xpu.inc.md