Speculative decoding

Knowledge graph concept · also referred to as multi-token prediction, MTP speculative decoding, spec. decoding

Mentioned in

• Theoretical limits can expose inference problems X thread · 2026-08-09
• Benchmarking Laguna S 2.1 on DGX Spark X thread · 2026-07-24
• Report Per-Session and Aggregate Token Throughput X thread · 2026-07-21
• Upper Bounds for Local Model Throughput X thread · 2026-07-17
• Write-up of Reiner Pope's Lecture: How GPT, Claude, and Gemini Are Actually Trained and Served post · 2026-07-14
• Towards 1-click setup for local models in OpenClaw X thread · 2026-05-15

Related concepts

• LLM inference 5
• Inference throughput 4
• Inference scaling 3
• KV cache 3
• Local model deployment 2
• Memory bandwidth 2
• Memory capacity 2
• Model quantization 2