Memory bandwidth Knowledge graph concept · also referred to as memory BW, HBM, memory bytes/s Mentioned in Write-up of Reiner Pope's Lecture: How GPT, Claude, and Gemini Are Actually Trained and Served post · 2026-07-14 Related concepts AI inference pricing 1 Inference batching 1 KV cache 1 LLM inference 1 Mixture-of-experts model 1 Roofline model 1 Speculative decoding 1