⌦abliteratedmodels.org

Abliterated models for 12 GB VRAM

Abliterated models that fit in 12 GB of GPU memory at the Q4_K_M quantisation with a 4,096-token context — RTX 3060 12GB, 4070 and comparable cards. 348 models qualify, the largest being 14B parameters at roughly 9.3 GB. Estimates are derived from parameter counts, not measured.

348 models↓ 16M downloads

Need a figure for your exact machine, including system RAM, a different quantisation or a longer context? Use the hardware checker.

Qwythos-9B-v2

9BOtheruncensored

from empero-ai/Qwythos-9B-v2

↓ 315K♥ 32411 repos

Showing the 120 most-downloaded of 348 models in this group. The remaining 228 are reachable through the full paginated index and are all listed in the sitemap.