Dense and MoE: what changes in practice
A dense model computes all of its weights for every token. An MoE keeps many "experts" in memory but activates only a few of them. Hence the main consequence: you save on computation, not on memory. The open flagship activates roughly 95 billion parameters, yet 2.4 trillion have to be resident in memory.
So an MoE wins where the bottleneck is inference speed, and loses where memory is short. For a home node this means one simple thing: a dense model up to 8–14B behaves more predictably than an MoE that keeps spilling to disk.
Do not look at the number in the name; look at how many weights must be resident in memory at the same time.