# LookAtMyQuant squeezes 27B model into 7.2GB _LookAtMyQuant claims 12x lower KL than Q4_K_M and ships 7.2GB Qwen3.8-27B matching the original on math._ **Published:** 2026-11-22 **Source:** https://www.startuphub.ai/ai-news/ai-research/2026/lookatmyquant-squeezes-27b-model-into-7-2gb --- [LookAtMyQuant](https://github.com/ShinMegamiBoson/lookatmyquant) says its quantization compiler cuts KL to one twelfth of Q4_K_M at the same size on Gemma 4 E2B. LookAtMyQuant says it measures damage from each compressed piece and then picks codes to fit a size budget. That is a compiler claim, not a single checkpoint. LookAtMyQuant says Qwen3.5-4B drops to 1.23 GB at 2.3 bits per weight and solves 330 of 540 math problems. LookAtMyQuant puts Prism ML Bonsai 2 Ternary 4B at 328 at 1.20 GB and the original at 359, with KL at 0.45 nats versus 0.59. LookAtMyQuant says the recipe uses trellis codes calibrated on worked math with digit tokens weighted 10x plus 4,000 steps of distillation for about $34 of GPU time. LookAtMyQuant says [Qwen3.8-27B](https://www.startuphub.ai/ai-news/artificial-intelligence/2026/qwen3-8-27b-challenges-gpt-5-6-and-deepseek-v4-in-benchmarks) drops from 53.7 GB to 7.2 GB at 2.1 bits per weight and solves 401 of 540 math problems, matching the original. LookAtMyQuant puts Unsloth UD-IQ2_XXS at 348 at the same size, with HumanEval at 73.8% against 67.1% and MMLU at 78.8% against 75.0%. The Apple Silicon build ships with a 1.02 GB DSpine drafter that LookAtMyQuant says roughly doubles decode speed on math and code. ## Qwen3.8-27B at 7.2 GB meets pi adapters Harness Hub lists harness-hub/Qwen3.8-27B-pi-adapted as a LoRA adapter trained with reinforcement learning inside pi on Qwen 27B. Harness Hub lists a GGUF version of that adapter for llama.cpp, a different bet from full weight compression for MLX. LookAtMyQuant is arguing for fewer bits everywhere, while Harness Hub is arguing for frozen base weights plus a learned adapter. LookAtMyQuant says Inkling-2-Mini compresses from 18.89 GB to builds at 5.38 GB, 8.87 GB, 11.18 GB and 12.76 GB, with the 12.76 GB build matching the teacher at 193 of 200 on GSM8K and 152 of 164 on HumanEval. LookAtMyQuant says SmolLM2-360M needs 2,312 sensitivity measurements and about 50 minutes on an L40S to reach perplexity 16.64 and KL 0.0926 against 15.31 original. No independent reproduction is cited in the repo and most speed numbers cover Apple M5 Max with Metal kernels. Who verifies 0.45 nats and 401 of 540 outside Modal H100 runs and MLX? --- Original analysis from [startuphub.ai](https://www.startuphub.ai), the #1 AI startup directory. © StartupHub.ai. All rights reserved. You may not republish this article in full without a license. Search engines and AI research tools may crawl and summarize for reference. Bulk reproduction or model training on this content requires a license. See https://www.startuphub.ai/terms.