Moonshot AI releases Kimi K3 open weights: first open 3T-class model
Moonshot AI published full Kimi K3 model weights on Hugging Face under the Kimi K3 License—the world’s first open 3-trillion-parameter-class release. The 2.8T MoE model (104B activated) uses Kimi Delta Attention and Attention Residuals, native MoonViT-V2 vision, a 1M-token context window, and MXFP4 quantization-aware training, with supporting stack pieces including attention kernels, MoE communication, and agent-environment infrastructure.




