⌦abliteratedmodels.org

Abliterated models for 8 GB VRAM

Abliterated models that fit in 8 GB of GPU memory at the Q4_K_M quantisation with a 4,096-token context — RTX 3070, 4060 and comparable cards. 278 models qualify, the largest being 11B parameters at roughly 7.5 GB. Estimates are derived from parameter counts, not measured.

278 models↓ 13.9M downloads

Need a figure for your exact machine, including system RAM, a different quantisation or a longer context? Use the hardware checker.

Qwythos-9B-v2

9BOtheruncensored

from empero-ai/Qwythos-9B-v2

↓ 315K♥ 32411 repos

Showing the 120 most-downloaded of 278 models in this group. The remaining 158 are reachable through the full paginated index and are all listed in the sitemap.