⌦abliteratedmodels.org

Abliterated models for 16 GB VRAM

Abliterated models that fit in 16 GB of GPU memory at the Q4_K_M quantisation with a 4,096-token context — RTX 4080, 4060 Ti 16GB and comparable cards. 386 models qualify, the largest being 24B parameters at roughly 15.4 GB. Estimates are derived from parameter counts, not measured.

386 models↓ 16.9M downloads

Need a figure for your exact machine, including system RAM, a different quantisation or a longer context? Use the hardware checker.

Qwythos-9B-v2

9BOtheruncensored

from empero-ai/Qwythos-9B-v2

↓ 315K♥ 32411 repos

Showing the 120 most-downloaded of 386 models in this group. The remaining 266 are reachable through the full paginated index and are all listed in the sitemap.