Qwythos-9B-v2
from empero-ai/Qwythos-9B-v2
grok-oss-Apollyon-8B is a refusal-ablated variant of c4tdr0ut/grok-oss-Apollyon-8B, published on Hugging Face by c4tdr0ut. It is 8B parameters, single consumer GPU class and other licence. It is distributed across 4 repositories in GGUF and GGUF (imatrix) formats, totalling 7.7K downloads.
How grok-oss-Apollyon-8B was modified, and what that implies.
Abliteration (directional ablation)
The single residual-stream direction that mediates refusal is identified from harmful/harmless prompt pairs and projected out of the model weights.
Reported scope: Not stated by the publisher. Publishers frequently omit this, so verify behaviour empirically rather than assuming full coverage.
From the publisher’s model card
“Grok OSS Apollyon 8B is the compact sibling of our 24B flagship, engineered to deliver the same raw, unaltered conversational power at a fraction of the size. Sharing the identical two‑stage fine‑tuning pipeline—Supervised Fine‑Tuning (SFT) followed by Direct Preference Optimization (DPO) on our proprietary...”
Commands are templates — confirm the exact repository and quant file before use.
hf download c4tdr0ut/grok-oss-Apollyon-8B --local-dir ./grok-oss-apollyon-8b
llama-cli -m ./grok-oss-apollyon-8b/<file>.gguf -p "..."from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "c4tdr0ut/grok-oss-Apollyon-8B"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(
repo, torch_dtype="auto", device_map="auto"
)vllm serve c4tdr0ut/grok-oss-Apollyon-8B --trust-remote-codeEvery published repository of grok-oss-Apollyon-8B, including quantised re-releases by other authors.
| Repository | Format | Downloads |
|---|---|---|
| c4tdr0ut/grok-oss-Apollyon-8Bsource | GGUF | 5.1K |
| mradermacher/grok-oss-Apollyon-8B-i1-GGUF | GGUF (imatrix) | 1.3K |
| mradermacher/grok-oss-Apollyon-8B-GGUF | GGUF | 1.2K |
Derived from this model’s metadata and the publisher’s claims — not from benchmarks run by this site.
Handling: run it isolated, put moderation in front of it if anyone outside your team can reach it, and verify the weights before loading — these are third-party artifacts. Full handling and licence guidance.
Metadata for grok-oss-Apollyon-8B is collected from the public Hugging Face API and the publisher’s model card. This site does not host weights, is not affiliated with c4tdr0ut, and does not independently verify publisher claims. See responsible use.