Mixture-of-experts model

Knowledge graph concept · also referred to as mixture-of-experts, MoE, experts, MoE model

Mentioned in

• Write-up of Reiner Pope's Lecture: How GPT, Claude, and Gemini Are Actually Trained and Served post · 2026-07-14
• Popularity rankings for open models X thread · 2026-06-20

Related concepts

• AI benchmark 1
• AI inference pricing 1
• Inference batching 1
• KV cache 1
• LLM inference 1
• Memory bandwidth 1
• Model quantization 1
• Model size 1