⌦abliteratedmodels.org

Abliterated models for 48 GB VRAM

Abliterated models that fit in 48 GB of GPU memory at the Q4_K_M quantisation with a 4,096-token context — RTX 6000 Ada, dual 3090 and comparable cards. 729 models qualify, the largest being 74B parameters at roughly 45.7 GB. Estimates are derived from parameter counts, not measured.

729 models↓ 49.6M downloads

Need a figure for your exact machine, including system RAM, a different quantisation or a longer context? Use the hardware checker.

Qwythos-9B-v2

9BOtheruncensored

from empero-ai/Qwythos-9B-v2

↓ 315K♥ 32411 repos

Qwythos-27B-v1

27BOtheruncensored

from empero-ai/Qwythos-27B-v1

↓ 192.3K♥ 1737 repos

Homura-30B

30BOtherheretic

from darkc0de/Muse-Glimmer-30B-heretic

↓ 85.4K♥ 323 repos

Showing the 120 most-downloaded of 729 models in this group. The remaining 609 are reachable through the full paginated index and are all listed in the sitemap.