Qwen3.6-27B-Heretic-GGUF (darkc0de)
Claude Opus推理蒸馏并反审查的27B模型GGUF版
社区实测
27B 密集模型在编码与 agentic 工作流中超越 397B MoE 前代,被社区公认同尺寸性价比顶尖;Heretic 无审查版在保持原模型能力的同时大幅降低拒答,且低量化版本在消费级硬件上即可流畅运行,速度与内存效率优于更大模型。
- 27B 密集模型在编码基准上超越 397B MoE 前代,代码生成能力越级
- 密集架构比 MoE 更易部署,本地推理门槛低
- 量化版本(Q4_K_M)仅需约 17–20GB 显存即可在消费级硬件运行
- Heretic 无审查版保持原模型能力的同时拒答率仅 6/100
- 在 agentic 编码与终端基准测试(Terminal-Bench 2.0)中表现突出
- 相比更大模型提供更快的推理速度与更低的内存占用
- NEO Di-Matrix 量化技术在量化形式下仍保持接近原模型的高性能
- 首个将无审查权重与完整 MTP 头结合的 GGUF 版本,补齐此前无审查版缺失 MTP 的短板
- 不同 GGUF 量化上传者质量存在差异,需要根据 KL 散度等指标选择
- 与专精编码模型(如 Coder-Next)相比并非在所有编码任务上都占优,选择需结合实际任务评估
- SVG 等创意生成任务表现不够稳定,偶有失真
Wow, Qwen3.6-27B is good : r/LocalLLMDavidAU/Qwen3.6-27B-Heretic-Uncensored-FINETUNE- ...Qwen3.6-27B Uncensored Heretic Is Out Now With KLD ...Qwen3.6-27B Abliterated + MTP GGUF — uncensored with ...If you want a good dense model, use qwen3.6 27B instead, speed will be up, and i... | Hacker NewsQwen3.5-27B-heretic-gguf : r/LocalLLaMAQwen3.6-27B: When a 27B Dense Model Beats a 397B Beast at Its Own GameQwen3.6-27B beats much larger predecessor on most coding benchmarksQwen3.6-27B Quantization Benchmark : r/LocalLLaMAQwen 3.6 27B GGUF Quality Benchmark: unsloth, lmstudio-community, Jackrong, bartowski, mradermacher, ubergarm, ggml-org comparedThe Qwen3 27B Versus Coder-Next Debate Is Really About Whether Founders Can Trust Reddit Benchmarks to Make Infrastructure Decisions - Startup FortuneEvaluating Qwen 3.6 27B: A Complete Benchmarking Case ...Qwen3.6-27B: 27B Model Beats 397B on Coding (2026)Qwen3.6-27B: Flagship-Level Coding in a 27B Dense Model
截至 2026-07-15
本形态 ~16GB 4-bit · 国内 需代理 · 132 下载
快速上手
ollama run hf.co/fzcfweasdferttgg/Qwen3.6-27B-Claude-Opus-Reasoning-Distill-v2-heretic-GGUF