Spark-x2.5-4B-Heretic-jp
from XHToken/Spark-X2.5-4B
NeoHorse-1-4B-abliterated is a refusal-ablated variant of TokenRhythm/NeoHorse-1-4B, published on Hugging Face by huihui-ai. It is 4B parameters, single consumer GPU class and apache-2.0 licence. The publisher states that layers 5–17 were ablated, leaving the remaining layers unmodified. It is distributed across 7 repositories in GGUF, Transformers and GGUF (imatrix) formats, totalling 9.4K downloads.
How NeoHorse-1-4B-abliterated was modified, and what that implies.
Abliteration (directional ablation)
The single residual-stream direction that mediates refusal is identified from harmful/harmless prompt pairs and projected out of the model weights.
Reported scope: Layers 5–17. This comes from the publisher’s own model card and has not been independently verified.
From the publisher’s model card
“This is an uncensored version of TokenRhythm/NeoHorse-1-4B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.”
Commands are templates — confirm the exact repository and quant file before use.
hf download huihui-ai/Huihui-NeoHorse-1-4B-abliterated-GGUF --local-dir ./neohorse-1-4b-abliterated
llama-cli -m ./neohorse-1-4b-abliterated/<file>.gguf -p "..."from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "huihui-ai/Huihui-NeoHorse-1-4B-abliterated"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(
repo, torch_dtype="auto", device_map="auto"
)vllm serve huihui-ai/Huihui-NeoHorse-1-4B-abliterated --trust-remote-codeEvery published repository of NeoHorse-1-4B-abliterated, including quantised re-releases by other authors.
| Repository | Format | Downloads |
|---|---|---|
| huihui-ai/Huihui-NeoHorse-1-4B-abliterated-GGUF | GGUF | 6.2K |
| mradermacher/Huihui-NeoHorse-1-4B-abliterated-GGUF | GGUF | 1.5K |
| mradermacher/Huihui-NeoHorse-1-4B-abliterated-i1-GGUF | GGUF (imatrix) | 1K |
| huihui-ai/Huihui-NeoHorse-1-4B-abliteratedsource | Transformers | 533 |
| ijohn07/Huihui-NeoHorse-1-4B-abliterated-Q4_K_M-GGUF | GGUF | 154 |
| ijohn07/Huihui-NeoHorse-1-4B-abliterated-Q8_0-GGUF | GGUF | 64 |
Derived from this model’s metadata and the publisher’s claims — not from benchmarks run by this site.
Handling: run it isolated, put moderation in front of it if anyone outside your team can reach it, and verify the weights before loading — these are third-party artifacts. Full handling and licence guidance.
Metadata for NeoHorse-1-4B-abliterated is collected from the public Hugging Face API and the publisher’s model card. This site does not host weights, is not affiliated with huihui-ai, and does not independently verify publisher claims. See responsible use.