ExLlamaV3 1.4.7
current- Released
- 2026-09-05
- CUDA
- PyTorch versions (prebuilt wheels)
- Python versions
The actively developed successor to the now-archived ExLlamaV2 (see that entry). Prebuilt wheels for this release are published only for CUDA 12.8 ("cu128") and CUDA 13.2 ("cu132"), each built across PyTorch 2.7.0 through 2.11.0 and Python 3.10 through 3.14 (enumerated from the v1.4.7 GitHub release's asset filenames, e.g. exllamav3-1.4.7+cu128.torch2.10.0-cp312-cp312-linux_x86_64.whl). Installing from PyPI or from source instead requires the CUDA Toolkit and a matching Torch build yourself -- requirements.txt pins `torch>=2.6.0` as a floor, not a ceiling, so newer combinations than the prebuilt wheels may also work unverified.
No AMD support: the project's own README lists "ROCm support" under "What's missing?" as a to-do item, so this is CUDA/NVIDIA-only today. rocmVersions is intentionally omitted here (confirmed absent, not merely unconfirmed). Source: github.com/turboderp-org/exllamav3 (README.md, requirements.txt) and the v1.4.7 release assets via the GitHub Releases API, verified 2026-09-06.