Post
  1. Portrait of Onur Solmaz

    DeepSeek is winning on unit economics

    @onusoz · /2026/09/10 · View on
    DeepSeek V4.1 Flash is NOT an LLM It is a hyper-efficient, invasive species designed to displace every other LLM, similar to how Döner displaced all other fast food in Germany As if V4 wasn't cheap and efficient enough, they made it a LOT cheaper 2.3x cheaper cached input tokens???? 1.5x cheaper uncached input and 10% cheaper output??? Are you for real? DS 4.1 Flash matches Sol in benchmark numbers It is size-wise probably comparable to Terra (I don't know how big it is...) Yet it is 33~66x cheaper than Terra and 66~133x cheaper than Sol depending on peak/off-peak hours. THAT IS TWO ORDER OF MAGNITUDE In other words, DeepSeek absolutely MOGS OpenAI in unit economics. See why in my previous post below Let's see what the vibes will say, but efficiency-wise my mind is blown
    @onusoz ·
    DeepSeek V4.1 Flash weights are out! ⚡️⚡️⚡️ I have good news and bad news Don't be fooled by "V4".1, this is a different architecture V4 was 284B total, 13B active V4.1 has a 552B MoE backbone + 196B engram conditional-memory parameters with 16B active parameters Bad news first. A single DGX Spark will likely not be able to hold all those parameters 😢 You will likely need 2 Sparks, or in general, a workstation with 256 GB. Could be a good time to get a loan... (not financial advice) DeepSeek has never claimed they were building for local use, but with this architecture, they show us that their main priority is for very efficient use in datacenters, with HBM, not local Good news: Looking at active parameters, you might be bummed out that decode will be slower on this, at 13/16 ~ 81% of the speed of V4 But wait!!! KV cache is 4x smaller. So decoding on this model will be a lot faster with concurrent sessions. And with speculative decoding, it seems like it might have 2-4x the throughput at scale, compared to V4. Back of the envelope calculation, I might pull back this prediction The small KV cache will also do something good for local inference, but I need more time to calculate how much. Take these with a grain of salt. Give your agent my formulation, and let me know if it looks like I made an error somewhere: solmaz.io/llm-throughput-upper-bounds Original safetensors: huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash