SemiAnalysis: Kimi K3's massive scale benefits Nvidia NVL72 inference architecture
Kimi K3's 2.8T+ parameters require large scale-up domains for weight storage, and its wide EP optimization spreads weights across GPUs demanding even more network bandwidth, makin…