Post @onusoz · /2026/09/15 · 11:25 AM View on Reminder, we have GPT 5.6 Terra at home (If you have 256 GB memory ðŸ˜) At a ridiculous, peanut-sized, 890 KV-cache bytes per token Pinnacle of efficiency by @deepseek_ai And we are just getting started @onusoz · Sep 15, 2026 I made DeepSeek V4.1 Flash play Settlers of Catan against GPT-5.6 Luna/Terra/Sol in 16 games, with different thinking settings DeepSeek was on Novita through Hugging Face Inference Providers DS beats Luna EASY Against Terra, games that finalized end up being a 4-4 tie --- while costing 6~7x LESS And Sol generally beat DS, but DS was still able to beat Sol 1 time (Whereas it seemed like Luna had no chance against DS) I tried to run 2 games where both DS and Terra had `max` thinking, but those games took too long and did not finalize Not the most rigorous benchmark runs I have done. But I can say that, both in subjective agentic coding performance and Catan-wise, DeepSeek V4.1 Flash sits somewhere between GPT 5.6 Terra and Sol, while costing a lot less than Terra If this gets enough interest, I will do more runs and might even RL a smaller model to beat all of them 😎 Inspect the runs yourself: huggingface.co/buckets/osolmaz/catanarchy-runs The harness and game simulator I have built: Show more
@onusoz · /2026/09/15 · 11:25 AM View on Reminder, we have GPT 5.6 Terra at home (If you have 256 GB memory ðŸ˜) At a ridiculous, peanut-sized, 890 KV-cache bytes per token Pinnacle of efficiency by @deepseek_ai And we are just getting started @onusoz · Sep 15, 2026 I made DeepSeek V4.1 Flash play Settlers of Catan against GPT-5.6 Luna/Terra/Sol in 16 games, with different thinking settings DeepSeek was on Novita through Hugging Face Inference Providers DS beats Luna EASY Against Terra, games that finalized end up being a 4-4 tie --- while costing 6~7x LESS And Sol generally beat DS, but DS was still able to beat Sol 1 time (Whereas it seemed like Luna had no chance against DS) I tried to run 2 games where both DS and Terra had `max` thinking, but those games took too long and did not finalize Not the most rigorous benchmark runs I have done. But I can say that, both in subjective agentic coding performance and Catan-wise, DeepSeek V4.1 Flash sits somewhere between GPT 5.6 Terra and Sol, while costing a lot less than Terra If this gets enough interest, I will do more runs and might even RL a smaller model to beat all of them 😎 Inspect the runs yourself: huggingface.co/buckets/osolmaz/catanarchy-runs The harness and game simulator I have built: Show more