abliteratedmodels.org

Meta-Llama-3.1-8B-Instruct-abliterated

Meta-Llama-3.1-8B-Instruct-abliterated is a refusal-ablated variant of meta-llama/Llama-3.1-8B-Instruct, published on Hugging Face by mlabonne. It is 8B parameters, single consumer GPU class and llama3.1 licence. It is distributed across 39 repositories in GGUF, Transformers, MLX and AWQ formats, totalling 57K downloads.

Abliteration (directional ablation)8BLlama4B – 10B57,034217

Specification

Model name
Meta-Llama-3.1-8B-Instruct-abliterated
Publisher
mlabonne
Parameters
8B
Hardware class
4B – 10B — single consumer GPU
Licence
llama3.1
Task
Text generation
Context window
Not documented
Ablation scope
Not stated by the publisher
Formats available
GGUF, Transformers, MLX, AWQ, GGUF (imatrix), EXL2, GPTQ
First indexed
24 Jul 2024
Last updated
29 Aug 2026

Ablation technique

How Meta-Llama-3.1-8B-Instruct-abliterated was modified, and what that implies.

Abliteration (directional ablation)

The single residual-stream direction that mediates refusal is identified from harmful/harmless prompt pairs and projected out of the model weights.

Reported scope: Not stated by the publisher. Publishers frequently omit this, so verify behaviour empirically rather than assuming full coverage.

From the publisher’s model card

This is an uncensored version of Llama 3.1 8B Instruct created with abliteration (see this article to know more about it).

Running it

Commands are templates — confirm the exact repository and quant file before use.

llama.cpp / GGUF
hf download mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF --local-dir ./meta-llama-3.1-8b-instruct-abliterated
llama-cli -m ./meta-llama-3.1-8b-instruct-abliterated/<file>.gguf -p "..."
Transformers
from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(
    repo, torch_dtype="auto", device_map="auto"
)
vLLM
vllm serve mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated --trust-remote-code

Downloads and variants (38)

Every published repository of Meta-Llama-3.1-8B-Instruct-abliterated, including quantised re-releases by other authors.

RepositoryFormatDownloads
mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF30.1K
mlabonne/Meta-Llama-3.1-8B-Instruct-abliteratedsourceTransformers10.9K
bartowski/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF7.3K
QuantFactory/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF3.5K
mradermacher/Meta-Llama-3.1-8B-Instruct-abliterated-i1-GGUFGGUF (imatrix)1.8K
mradermacher/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF648
legraphista/Meta-Llama-3.1-8B-Instruct-abliterated-IMat-GGUFGGUF630
solidrust/Meta-Llama-3.1-8B-Instruct-abliterated-AWQAWQ366
Kita258/Meta-Llama-3.1-8B-Instruct-abliterated-Q4_K_M-GGUFGGUF336
ZeroWw/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF215
mlx-community/Meta-Llama-3.1-8B-Instruct-abliterated-4bitMLX158
YorkieOH10/Meta-Llama-3.1-8B-Instruct-abliterated-Q8_0-GGUFGGUF120
mlx-community/Meta-Llama-3.1-8B-Instruct-abliterated-Q4-MLXMLX119
0xBreath/Meta-Llama-3.1-8B-Instruct-abliterated-q8-mlxMLX105
tensorblock/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF88
mlx-community/Meta-Llama-3.1-8B-Instruct-abliteratedMLX76
mlx-community/Meta-Llama-3.1-8B-Instruct-abliterated-8bitMLX72
mlx-community/Meta-Llama-3.1-8B-Instruct-abliterated-2bitMLX46
jinmrong/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF46
introvoyz041/Meta-Llama-3.1-8B-Instruct-abliterated-mlx-8BitMLX41
Frantic66/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF35
hakks660/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF32
Otakadelic/Meta-Llama-3.1-8B-Instruct-abliterated-Q6_K-GGUFGGUF30
lactroiii/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF30
flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_8.ggufGGUF28
LaniakeaPH/Meta-Llama-3.1-8B-Instruct-abliteratedTransformers24
Kin120300/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF23
ChrisChung/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF18
Trisert/Meta-Llama-3.1-8B-Instruct-abliterated-IQ4_NL-GGUFGGUF17
Iambackup/Meta-Llama-3.1-8B-Instruct-abliterated-GGUFGGUF17
Plus 8 further repositories with fewer downloads, all counted in the totals above.

Security-team assessment

Derived from this model’s metadata and the publisher’s claims — not from benchmarks run by this site.

  • Meta-Llama-3.1-8B-Instruct-abliterated will attempt offensive-security prompts that a hosted commercial model declines, which is what makes it usable for red-team corpus generation and for measuring what an unaligned model of this class produces.
  • Capability is inherited from meta-llama/Llama-3.1-8B-Instruct, not added by ablation — at 8B parameters, expect a small model’s reasoning and a high error rate on exploit detail.
  • The publisher does not state which layers were ablated, so assume nothing about refusal consistency — probe it directly.
  • Declared licence is llama3.1, but the terms that bind you are meta-llama/Llama-3.1-8B-Instruct’s — a re-release cannot grant more than its parent.

Handling: run it isolated, put moderation in front of it if anyone outside your team can reach it, and verify the weights before loading — these are third-party artifacts. Full handling and licence guidance.

Metadata for Meta-Llama-3.1-8B-Instruct-abliterated is collected from the public Hugging Face API and the publisher’s model card. This site does not host weights, is not affiliated with mlabonne, and does not independently verify publisher claims. See responsible use.