Moonshot AI Unveils Kimi K3: World's First Open 2.8T Parameter Multimodal Model with Kimi Delta Attention
Moonshot AI launches Kimi K3, a 2.8-trillion parameter multimodal model utilizing Stable LatentMoE with 16-of-896 expert activation, Attention Residuals, and a 1M token context window.
Moonshot AI has released **Kimi K3**, crowned as the world's first open 3T-class foundation model, logging over 2.2 million downloads in its first 72 hours.
2.8 Trillion Parameters with Stable LatentMoE Kimi K3 features a radical sparsity design: while housing 2.8 trillion total parameters, its **Stable LatentMoE** routing activates just **16 out of 896 specialized experts** per token. This delivers a 2.5Γ improvement in scaling efficiency over the previous Kimi K2 architecture.
Benchmark Dominance in Tool Orchestration On independent evaluations, Kimi K3 achieved: - **76.5% on Toolathlon Verified** (#1 among open-weights systems). - **88.3% on Terminal Bench 2.1** for long-horizon terminal tool use. - **67.5% on DeepSWE (v1.1)** software engineering benchmarks.
Kimi K3 integrates native vision encoders, enabling vision-in-the-loop CAD engineering, compiler development, and full-stack autonomous application delivery across 1,000,000 tokens.
Advertisement
View Blueprints β
Verified Partner
Quantitative Trading Systems & 30 AI Business Blueprints
Build predictable monthly recurring revenue with retainers & automated bots.
Source & Fact Check
This technical dispatch was verified against primary documentation released by Moonshot AI.
Read Original Announcement on Moonshot AI β