Kimi K3 2.8T parameters

by Vojtech: Moonshot AI

Do you realize what Moonshot just released? Kimi K3. 2.8 trillion parameters. The largest open model ever shipped. DeepSeek V4-Pro sits at 1.6T. Everything else this year was under 1T. 1 million token context, native, not RAG-extended. Kimi Delta Attention: up to