Qwen3.8-27B-ARA-abliterated
from trohrbaugh/Qwen3.8-27B-heretic-ara
Qwen3.8-27B-heretic-ara-oQ4e is a Heretic-ablated variant of trohrbaugh/Qwen3.8-27B-heretic-ara, published on Hugging Face by underlotus. It is 27B parameters, 48GB VRAM class class and apache-2.0 licence. It is distributed across 2 repositories in MLX format, totalling 5.7K downloads.
How Qwen3.8-27B-heretic-ara-oQ4e was modified, and what that implies.
Heretic
Automated directional ablation via the Heretic toolchain, which searches for the refusal direction and applies it with a KL-divergence budget so general capability is preserved.
Reported scope: Not stated by the publisher. Publishers frequently omit this, so verify behaviour empirically rather than assuming full coverage.
From the publisher’s model card
“Mixed-precision quant of trohrbaugh/Qwen3.8-27B-heretic-ara, produced with oQ (oMLX v0.5.8.dev1). Vision tower intact — image + video input still works. MTP head preserved. Standard MLX safetensors — compatible with oMLX, mlx-lm, LM Studio, and any MLX-capable app.”
Commands are templates — confirm the exact repository and quant file before use.
from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "underlotus/Qwen3.8-27B-heretic-ara-oQ4e-mtp"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(
repo, torch_dtype="auto", device_map="auto"
)vllm serve underlotus/Qwen3.8-27B-heretic-ara-oQ4e-mtp --trust-remote-codeThe only published repository of Qwen3.8-27B-heretic-ara-oQ4e.
| Repository | Format | Downloads |
|---|---|---|
| underlotus/Qwen3.8-27B-heretic-ara-oQ4e-mtpsource | MLX | 5.7K |
Derived from this model’s metadata and the publisher’s claims — not from benchmarks run by this site.
Handling: run it isolated, put moderation in front of it if anyone outside your team can reach it, and verify the weights before loading — these are third-party artifacts. Full handling and licence guidance.
Metadata for Qwen3.8-27B-heretic-ara-oQ4e is collected from the public Hugging Face API and the publisher’s model card. This site does not host weights, is not affiliated with underlotus, and does not independently verify publisher claims. See responsible use.