Quantization-Aware Healing: a compressed, 4-bit model that outperforms its full-precision original

Introduces Quantization-Aware Healing (QAH), a method that distills from the original pre-compression model to recover capabilities lost during structural compression and quantization.

Applied to a GPT-OSS 120B model compressed to 60B and quantized to MXFP4, it outperforms its own full-precision version on 7 of 9 benchmarks.