Post
  1. Portrait of Onur Solmaz

    Qwen3.8 27B compressed to 5.95 GB, running in a browser

    @onusoz · /2026/09/18 · View on
    Exciting! PrismML just launched a version of Qwen3.8 27B weights that are compressed down to 5.95 GB and that runs on my browser on Macbook Pro with 30 tok/s If it indeed is as lossless as they claim, then this will be a gamechanger for devices with 16 GB of ram! I will run some benchmarks on it and will keep you posted! Go try it out in the Hugging Face space:
    @PrismML ·
    Today, we’re announcing Ternary Bonsai 2 27B. Based on Qwen3.8 27B, Bonsai 2 27B is 9x smaller than its full-precision counterpart while retaining 98.2% of its aggregate benchmark performance. Two months after the first Bonsai 27B release, the biggest change is quality. The footprint remains 5.9 GB, but the gap to full precision has narrowed materially, with particularly strong gains in agentic coding, multimodal reasoning, and long-horizon tool use. Ternary Bonsai 2 27B is available today under Apache 2.0.