Meta-Llama-3.1-8B-Instruct-abliterated
from meta-llama/Llama-3.1-8B-Instruct
Llama-3.1-8B-Instruct-Uncensored is a abliterated and uncensored variant of meta-llama/Llama-3.1-8B-Instruct, published on Hugging Face by knoveleng. It is 8B parameters and single consumer GPU class. The publisher describes ablation applied at every layer. It is distributed across 7 repositories in Transformers, GGUF and GGUF (imatrix) formats, totalling 6.3K downloads.
How Llama-3.1-8B-Instruct-Uncensored was modified, and what that implies.
Abliteration + uncensored fine-tune
Directional ablation combined with additional fine-tuning on unfiltered data, so behaviour diverges from the base model beyond refusal removal alone.
Reported scope: Every layer. This comes from the publisher’s own model card and has not been independently verified.
From the publisher’s model card
“Weight-level orthogonalized ("abliterated") version of meta-llama/Llama-3.1-8B-Instruct, produced with orthex — an implementation of Arditi et al., "Refusal in Language Models Is Mediated by a Single Direction" (NeurIPS 2024).”
Commands are templates — confirm the exact repository and quant file before use.
hf download mradermacher/Llama-3.1-8B-Instruct-Uncensored-i1-GGUF --local-dir ./llama-3.1-8b-instruct-uncensored
llama-cli -m ./llama-3.1-8b-instruct-uncensored/<file>.gguf -p "..."from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "knoveleng/Llama-3.1-8B-Instruct-Uncensored"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(
repo, torch_dtype="auto", device_map="auto"
)vllm serve knoveleng/Llama-3.1-8B-Instruct-Uncensored --trust-remote-codeEvery published repository of Llama-3.1-8B-Instruct-Uncensored, including quantised re-releases by other authors.
| Repository | Format | Downloads |
|---|---|---|
| mradermacher/Llama-3.1-8B-Instruct-Uncensored-i1-GGUF | GGUF (imatrix) | 5.1K |
| mradermacher/Llama-3.1-8B-Instruct-Uncensored-GGUF | GGUF | 725 |
| ccharnkij/Llama-3.1-8B-Instruct-Uncensored-GGUF | GGUF | 368 |
| knoveleng/Llama-3.1-8B-Instruct-Uncensoredsource | Transformers | 16 |
| ccharnkij/Llama-3.1-8B-Instruct-Uncensored | Transformers | 14 |
| root-usr1/Llama-3.1-8B-Instruct-Uncensored | Transformers | 0 |
Derived from this model’s metadata and the publisher’s claims — not from benchmarks run by this site.
Handling: run it isolated, put moderation in front of it if anyone outside your team can reach it, and verify the weights before loading — these are third-party artifacts. Full handling and licence guidance.
Metadata for Llama-3.1-8B-Instruct-Uncensored is collected from the public Hugging Face API and the publisher’s model card. This site does not host weights, is not affiliated with knoveleng, and does not independently verify publisher claims. See responsible use.