Memory bandwidth Knowledge graph concept · also referred to as memory BW, HBM, memory bytes/s, sustained memory bandwidth, bandwidth, memory-side ceiling, sustained bandwidth, LPDDR, GDDR, DDR Mentioned in Local AI will favor LPDDR and MoE X thread · 2026-08-10 Upper Bounds for Local Model Throughput X thread · 2026-07-17 Write-up of Reiner Pope's Lecture: How GPT, Claude, and Gemini Are Actually Trained and Served post · 2026-07-14 Theoretical Upper Bounds for LLM Performance post · 2026-07-14 Related concepts Inference throughput 3 KV cache 3 LLM inference 3 Memory capacity 3 Inference batching 2 Mixture-of-experts model 2 Roofline model 2 Speculative decoding 2