Open-weight AI just hit 2.8 trillion parameters…

Fireship

Summary

The video introduces Kimi K3, a new open-source AI model by Chinese lab Moonshot, featuring 2.8 trillion parameters and a 1 million token context window. Kimi K3's benchmark performance rivals or exceeds leading proprietary models like Claude Fable and GPT-5.6 Soul, particularly in coding. Despite its impressive capabilities, it exhibits high hallucination rates and excessive token generation. The release of Kimi K3 with open weights is accelerating the AI arms race and sparking significant geopolitical debate, with China advocating for open AI while the US considers regulations or bans due to economic and security concerns. The model's power also highlights the substantial computational resources required for its deployment.

Chapters

  1. 0:00Kimi K3's Breakthrough and Impact
  2. 0:45Kimi K3 Architecture and Scale
  3. 1:38Benchmarks and Self-Hosting K3
  4. 2:14Kimi K3's Limitations
  5. 2:59Geopolitics of Open-Weight AI
  6. 3:59Advancing AI and UI Design

Topics covered

  • Kimi K3's Release and Impact
  • Kimi K3's Technical Specifications

+6 more topics (full content when you follow the channel)

Transcript excerpt

Last week, Chinese AI lab Moonshot dropped Kimi K3, a massive open-source monster that instantly parameter mogged every other open model in existence. And not just that, it has OpenAI and Anthropic terrified because its trust-me-bro benchmark performance is on par with, and in some cases beating, Claude Fable and GPT-5.6 Soul. And that's crazy because just a few weeks ago, the government was telling you these models were too dangerous for the common man to use. It only took the Chinese a few weeks to match their performance and then give away all the weights for free. But big AI is not too happy about this, and there are already calls to ban Chinese models completely in the United States. In today's video, we'll take a look at the massive breakthrough that is Kimi K3 and find out what it means for the future of artificial intelligence. It is July 2026, and you're watching The Code 22nd,…