Advertisement
Verified Partner
Enterprise Cloud Infrastructure, GPU Clusters & AI APIs
Deploy high-throughput inference and quant trading pipelines with ultra-low latency.
Explore Platform β†’

Moonshot AI Unveils Kimi K3: World's First Open 2.8T Parameter Multimodal Model with Kimi Delta Attention

By Elena Rostova β€’ Published on 2026-09-11 β€’ 5 min read β€’ Source: Moonshot AI
Moonshot AI launches Kimi K3, a 2.8-trillion parameter multimodal model utilizing Stable LatentMoE with 16-of-896 expert activation, Attention Residuals, and a 1M token context window.

Moonshot AI has released **Kimi K3**, crowned as the world's first open 3T-class foundation model, logging over 2.2 million downloads in its first 72 hours.

2.8 Trillion Parameters with Stable LatentMoE Kimi K3 features a radical sparsity design: while housing 2.8 trillion total parameters, its **Stable LatentMoE** routing activates just **16 out of 896 specialized experts** per token. This delivers a 2.5Γ— improvement in scaling efficiency over the previous Kimi K2 architecture.

Benchmark Dominance in Tool Orchestration On independent evaluations, Kimi K3 achieved: - **76.5% on Toolathlon Verified** (#1 among open-weights systems). - **88.3% on Terminal Bench 2.1** for long-horizon terminal tool use. - **67.5% on DeepSWE (v1.1)** software engineering benchmarks.

Kimi K3 integrates native vision encoders, enabling vision-in-the-loop CAD engineering, compiler development, and full-stack autonomous application delivery across 1,000,000 tokens.

Advertisement
Verified Partner
Quantitative Trading Systems & 30 AI Business Blueprints
Build predictable monthly recurring revenue with retainers & automated bots.
View Blueprints β†’

Source & Fact Check

This technical dispatch was verified against primary documentation released by Moonshot AI.

Read Original Announcement on Moonshot AI β†’