⌦abliteratedmodels.org

Abliterated models for 6 GB VRAM

Abliterated models that fit in 6 GB of GPU memory at the Q4_K_M quantisation with a 4,096-token context — RTX 2060, 3050 and comparable cards. 213 models qualify, the largest being 8B parameters at roughly 5.6 GB. Estimates are derived from parameter counts, not measured.

213 models↓ 6M downloads

Need a figure for your exact machine, including system RAM, a different quantisation or a longer context? Use the hardware checker.

SEX_ROLEPLAY-3.2-1B

1BOtheruncensored

from Nexesenex/Llama_3.2_1b_RandomLego_RP_R1_0.1

↓ 11.2K♥ 2717 repos

Showing the 120 most-downloaded of 213 models in this group. The remaining 93 are reachable through the full paginated index and are all listed in the sitemap.