Memory capacity Knowledge graph concept · also referred to as usable memory capacity, resident fit, capacity Mentioned in Upper Bounds for Local Model Throughput X thread · 2026-07-17 Theoretical Upper Bounds for LLM Performance post · 2026-07-14 Related concepts Inference throughput 2 KV cache 2 LLM inference 2 Memory bandwidth 2 Inference batching 1 Inference scaling 1 Memory power 1 Model quantization 1