Mixture-of-experts model

Knowledge graph concept · also referred to as mixture-of-experts, MoE, experts, MoE model, active parameters

Mentioned in

• Local AI will favor LPDDR and MoE X thread · 2026-08-10
• Write-up of Reiner Pope's Lecture: How GPT, Claude, and Gemini Are Actually Trained and Served post · 2026-07-14
• Popularity rankings for open models X thread · 2026-06-20

Related concepts

• Memory bandwidth 2
• Model size 2
• AI benchmark 1
• AI inference pricing 1
• Computing energy consumption 1
• Inference batching 1
• Inference throughput 1
• KV cache 1