Post
-
Ran Laguna S 2.1 *theoretical* (not measured) upper bound calculations for the DGX spark poolside/Laguna-S-2.1-NVFP4 - max ~25 tok/s single session. if you are willing to go down to 12 tok/s, you can have 4 sessions in parallel vcruz305/Laguna-S-2.1-GGUF (IQ1_S) - max ~74 tok/s single session. theoretical 5x20 tok/s = 100 tok/s aggregate upper bound Calculated assuming no speculative decoding, so might increase well over these numbers See my local frontier app and my previous posts for more info on the methodologyImage hidden