Quantization Regime and Governed Routing: A 2x2 Study of QAT Q4_0 versus PTQ Q4_K_M for Gemma 4 12B (dense) and 26B MoE under a Fixed Governance Stack
Abstract
A 2×2 study (quantization regime × released model pair) of governed routing quality for Gemma 4 12B (dense; a clean same-base pair) and a 26B-class MoE released pair on one RTX 5070 Ti, run under a fixed, bit-identical governance stack via Ollama at temperature 0. Within-pair regime effects (QAT Q4_0 vs PTQ Q4_K_M) are individually marginal and oppositely signed: −0.012 on the dense 12B (exact McNemar p=0.070) and +0.018 on the MoE pair (p=0.078). The regime × pair interaction — an exploratory, single-run endpoint — is +0.030 with a stem-clustered bootstrap 95% CI of [+0.010, +0.052] (Core-500 is 100 paraphrase stems × 5 variants), concentrated in the volatile-current task family. Only 23–32% of same-task temperature-0 outputs are byte-identical across regimes, against same-configuration repeat baselines of 100/100 in all four cells and a 100/100 num_ctx byte-identity control: quantization regime is a behavioral change, not merely a quality change. Attribution is bounded to the released artifact pairs (the 26B pair confounds regime with a possible base revision and a CPU-offload compute path). Safety-critical failure rates are 0.000 in seven of eight runs (one over-verification event, 0.008, in 26B-PTQ Core-500). The public package (paper, processed data, deterministic analysis script, environment and artifact hashes) is at github.com/mobius-style/gemma4-quant-regime-study (v1.0.1). Verbatim task prompts and generated outputs are excluded by policy and identified by SHA-256. The manuscript was adversarially reviewed pre-deposit by three independent AI reviewers (statistics / consistency / scope); all MAJOR findings were remediated in v1.0.1. AI assistance: Claude Code (Anthropic, model Fable 5), working method only; the registered author is the human author alone. Companion/sequel to the Gemma 4 MTP quality–throughput study, DOI 10.5281/zenodo.21860461.
// Source
Authors: Toeda Taiko
Institutions: Yulius