ExLlamaV2 0.3.2 (last release)

archived
Released
2025-07-13
CUDA
12.1
ExLlamaV2's own README states up front: "This project is archived for now. Development continues on ExLlamaV3" -- v0.3.2 (2025-07-13) is its last tagged GitHub release and the repository has seen no further releases since. See the exllamav3 entry on this page for the actively maintained successor. cudaVersions (12.1) reflects the `cu121` tag on this project's documented example prebuilt-wheel filename, not a currently-maintained compatibility claim -- treat it as historical context, not installation guidance. ExLlamaV2 was CUDA/PyTorch-only: its setup.py does branch on `torch.version.hip` for an AMD/HIP code path, but no ROCm wheels or ROCm version support were ever documented for it, so rocmVersions is left unset here rather than guessed. Source: github.com/turboderp-org/exllamav2 (README.md, setup.py) and the GitHub Releases API, verified 2026-09-06.

← All ExLlamaV2 entries · All inference engines →