Which GPUs does bitsandbytes support?
bitsandbytes 0.50.2: 50 of the 65 GPUs tracked here are supported, from the library's own requirements. Checked 2026-09-27.
The rule
- NVIDIA: builds compiled for compute capability 6.0, 7.0, 7.5, 8.0, 8.6, 8.9, 9.0, 10.0, 12.0, which also cover newer minor versions of each (8.0 code runs on 8.6 and 8.9). LLM.int8() needs 7.5+.
- AMD: gfx908, gfx90a, gfx942, gfx950, gfx1250, gfx1010, gfx1011, gfx1012, gfx1030, gfx1031, gfx1032, gfx1033, gfx1034, gfx1035, gfx1036, gfx1100, gfx1101, gfx1102, gfx1103, gfx1150, gfx1151, gfx1152, gfx1153, gfx1200, gfx1201. Pre-built for ROCm 7.14.0 and 10.0.0 (Linux x86_64); older ROCm builds cover fewer RDNA targets.
- Intel: supported. Intel XPU through PyTorch's XPU backend (PyTorch 2.6+).
From the installation docs (2026-09-27): NVIDIA compute capability 6.0+, with LLM.int8() needing 7.5+ (8-bit optimizers and NF4/FP4 quantization need 6.0+). compiledFor is the union of the Linux x86_64 PyPI wheel targets across its CUDA builds (11.8-12.6: sm60-sm90; 12.8: sm70-sm120; 13.0-13.2: sm75-sm120). The AMD list is the ROCm 7.14.0 / 10.0.0 Linux wheel targets. The RX 6700 XT's gfx1031 and RX 6600's gfx1032 are included there, though ROCm itself doesn't officially support those cards.
Supported (50)
| GPU | Vendor | Target | Details |
|---|---|---|---|
| B300 (Blackwell Ultra) | NVIDIA | 10.3 | |
| DGX Spark | NVIDIA | 12.1 | |
| RTX 5060 Ti 16GB | NVIDIA | 12.0 | |
| RTX 5090 | NVIDIA | 12.0 | |
| RTX PRO 6000 Blackwell | NVIDIA | 12.0 | |
| B200 | NVIDIA | 10.0 | |
| H200 SXM 141GB | NVIDIA | 9.0 | |
| L40S | NVIDIA | 8.9 | |
| RTX 4060 Ti 16GB | NVIDIA | 8.9 | |
| H100 SXM5 80GB | NVIDIA | 9.0 | |
| RTX 4090 | NVIDIA | 8.9 | |
| RTX 6000 Ada Generation | NVIDIA | 8.9 | |
| RTX 3060 12GB | NVIDIA | 8.6 | |
| A100 SXM4 80GB | NVIDIA | 8.0 | |
| RTX 3090 | NVIDIA | 8.6 | |
| T4 | NVIDIA | 7.5 | |
| TITAN RTX | NVIDIA | 7.5 | |
| Instinct MI350X | AMD | gfx950 | |
| Instinct MI355X | AMD | gfx950 | |
| Radeon AI PRO R9700 | AMD | gfx1201 | |
| Radeon RX 9060 XT (16GB) | AMD | gfx1200 | |
| Radeon RX 9060 XT (8GB) | AMD | gfx1200 | |
| Radeon RX 9070 | AMD | gfx1201 | |
| Radeon RX 9070 XT | AMD | gfx1201 | |
| Ryzen AI Max+ 395 | AMD | gfx1151 | |
| Instinct MI325X | AMD | gfx942 | |
| Radeon RX 7600 XT | AMD | gfx1102 | |
| Instinct MI300A | AMD | gfx942 | |
| Instinct MI300X | AMD | gfx942 | |
| Radeon RX 7700 XT | AMD | gfx1101 | |
| Radeon RX 7800 XT | AMD | gfx1101 | |
| Radeon RX 7900 GRE | AMD | gfx1100 | |
| Instinct MI210 | AMD | gfx90a | |
| Radeon RX 6650 XT | AMD | gfx1032 | |
| Radeon RX 6750 XT | AMD | gfx1031 | |
| Radeon RX 6950 XT | AMD | gfx1030 | |
| Radeon RX 7900 XT | AMD | gfx1100 | |
| Radeon RX 7900 XTX | AMD | gfx1100 | |
| Instinct MI250X | AMD | gfx90a | |
| Radeon RX 6600 | AMD | gfx1032 | |
| Radeon RX 6700 XT | AMD | gfx1031 | |
| Instinct MI100 | AMD | gfx908 | |
| Radeon RX 6800 | AMD | gfx1030 | |
| Radeon RX 6800 XT | AMD | gfx1030 | |
| Radeon RX 6900 XT | AMD | gfx1030 | |
| Arc B580 | Intel | — | Intel XPU through PyTorch's XPU backend (PyTorch 2.6+). |
| Data Center GPU Max 1550 | Intel | — | Intel XPU through PyTorch's XPU backend (PyTorch 2.6+). |
| Arc A380 | Intel | — | Intel XPU through PyTorch's XPU backend (PyTorch 2.6+). |
| Arc A750 | Intel | — | Intel XPU through PyTorch's XPU backend (PyTorch 2.6+). |
| Arc A770 (16GB) | Intel | — | Intel XPU through PyTorch's XPU backend (PyTorch 2.6+). |
Partly supported (6)
| GPU | Vendor | Target | Details |
|---|---|---|---|
| GTX 1080 Ti | NVIDIA | 6.1 | no LLM.int8() (needs 7.5+) |
| TITAN V | NVIDIA | 7.0 | no LLM.int8() (needs 7.5+) |
| V100 SXM2 32GB | NVIDIA | 7.0 | no LLM.int8() (needs 7.5+) |
| P100 SXM2 16GB | NVIDIA | 6.0 | no LLM.int8() (needs 7.5+) |
| Tesla P40 | NVIDIA | 6.1 | no LLM.int8() (needs 7.5+) |
| TITAN X (Pascal) | NVIDIA | 6.1 | no LLM.int8() (needs 7.5+) |
Not supported (8)
| GPU | Vendor | Target | Details |
|---|---|---|---|
| M40 24GB | NVIDIA | 5.2 | no build for compute capability 5.2 |
| K80 | NVIDIA | 3.7 | no build for compute capability 3.7 |
| Radeon VII | AMD | gfx906 | |
| Radeon Instinct MI50 | AMD | gfx906 | |
| Radeon Instinct MI60 | AMD | gfx906 | |
| Radeon Instinct MI25 | AMD | gfx900 | |
| Radeon Instinct MI6 | AMD | gfx803 | |
| Radeon Instinct MI8 | AMD | gfx803 |
Not enough data (1)
| GPU | Vendor | Target | Details |
|---|---|---|---|
| Instinct MI455X | AMD | — | gfx target not recorded |
Sources: github.com/bitsandbytes-foundation/bitsandbytes/blob/main/docs/source/installation.mdx