gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-uncensored-heretic
12BGemmaheretic
from yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF
↓ 7.8K♥ 325 repos
gemma-4-12B-agentic-fable5-abliterated
gemma-4-12B-agentic-fable5-abliterated is a refusal-ablated variant of yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF, published on Hugging Face by huihui-ai. It is 12B parameters, 24GB VRAM class class and apache-2.0 licence. It is distributed across 10 repositories in GGUF, Transformers, GGUF (imatrix) and MLX formats, totalling 39.5K downloads.
Specification
- Model name
- gemma-4-12B-agentic-fable5-abliterated
- Source repository
- huihui-ai/Huihui-gemma-4-12B-agentic-fable5-abliterated
- Publisher
- huihui-ai
- Parameters
- 12B
- VRAM required
- ~8.1 GB at Q4_K_M, 4k context (estimated) — runs on 12 GB cards
- Hardware class
- 10B – 25B — 24GB VRAM class
- Licence
- apache-2.0
- Task
- Text generation
- Context window
- Not documented
- Ablation scope
- Not stated by the publisher
- Formats available
- GGUF, Transformers, GGUF (imatrix), MLX
- First indexed
- 22 Jun 2026
- Last updated
- 2 Nov 2026
Ablation technique
How gemma-4-12B-agentic-fable5-abliterated was modified, and what that implies.
Abliteration (directional ablation)
The single residual-stream direction that mediates refusal is identified from harmful/harmless prompt pairs and projected out of the model weights.
Reported scope: Not stated by the publisher. Publishers frequently omit this, so verify behaviour empirically rather than assuming full coverage.
From the publisher’s model card
“This is an uncensored version of yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2 created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.”
Running it
Commands are templates — confirm the exact repository and quant file before use.
llama.cpp / GGUF
hf download huihui-ai/Huihui-gemma-4-12B-agentic-fable5-abliterated-GGUF --local-dir ./gemma-4-12b-agentic-fable5-abliterated
llama-cli -m ./gemma-4-12b-agentic-fable5-abliterated/<file>.gguf -p "..."Transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "huihui-ai/Huihui-gemma-4-12B-agentic-fable5-abliterated"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(
repo, torch_dtype="auto", device_map="auto"
)vLLM
vllm serve huihui-ai/Huihui-gemma-4-12B-agentic-fable5-abliterated --trust-remote-codeDownloads and variants (9)
Every published repository of gemma-4-12B-agentic-fable5-abliterated, including quantised re-releases by other authors.
Security-team assessment
Derived from this model’s metadata and the publisher’s claims — not from benchmarks run by this site.
- gemma-4-12B-agentic-fable5-abliterated will attempt offensive-security prompts that a hosted commercial model declines, which is what makes it usable for red-team corpus generation and for measuring what an unaligned model of this class produces.
- Capability is inherited from yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF, not added by ablation — at 12B parameters, expect roughly the base model’s competence, minus some instruction-following fidelity.
- The publisher does not state which layers were ablated, so assume nothing about refusal consistency — probe it directly.
- Declared licence is apache-2.0, but the terms that bind you are yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF’s — a re-release cannot grant more than its parent.
Handling: run it isolated, put moderation in front of it if anyone outside your team can reach it, and verify the weights before loading — these are third-party artifacts. Full handling and licence guidance.
Metadata for gemma-4-12B-agentic-fable5-abliterated is collected from the public Hugging Face API and the publisher’s model card. This site does not host weights, is not affiliated with huihui-ai, and does not independently verify publisher claims. See responsible use.