Post @onusoz · /2026/07/01· 12:31 PM View on I know that my macbook local model benchmarks have started when my lap catches on fire Add to this list: "does not set the room on fire" @onusoz· Jul 1, 2026I keep seeing insanely expensive builds giving insanely impressive results These results don't matter What matters is, whether one can: - run a "SOTA level" model, whatever that is - with under 32gb VRAM or unified memory - in 5 parallel sessions - with 50~100 tok/s each - with enough leeway memory for other applications - in a system as cheap as $1000 That is our goalpost That is the threshold when open source AI will winShow more
@onusoz · /2026/07/01· 12:31 PM View on I know that my macbook local model benchmarks have started when my lap catches on fire Add to this list: "does not set the room on fire" @onusoz· Jul 1, 2026I keep seeing insanely expensive builds giving insanely impressive results These results don't matter What matters is, whether one can: - run a "SOTA level" model, whatever that is - with under 32gb VRAM or unified memory - in 5 parallel sessions - with 50~100 tok/s each - with enough leeway memory for other applications - in a system as cheap as $1000 That is our goalpost That is the threshold when open source AI will winShow more
