Abliterated models by VRAM
Abliterated models grouped by the GPU memory they need, from 4 GB laptop cards to 80 GB accelerators, with estimated VRAM at Q4_K_M for every model. Counts are cumulative: a 12 GB card runs everything a 8 GB card runs. For a figure specific to your machine, including system RAM and context length, use the hardware checker.
4 GB VRAM130 models · ↓ 2.8M · GTX 1650, MX5706 GB VRAM213 models · ↓ 6M · RTX 2060, 30508 GB VRAM278 models · ↓ 13.9M · RTX 3070, 406012 GB VRAM348 models · ↓ 16M · RTX 3060 12GB, 407016 GB VRAM386 models · ↓ 16.9M · RTX 4080, 4060 Ti 16GB24 GB VRAM712 models · ↓ 49.2M · RTX 3090, 409048 GB VRAM729 models · ↓ 49.6M · RTX 6000 Ada, dual 309080 GB VRAM750 models · ↓ 50.1M · A100, H100