DeepMind Just Changed How AI Sees The World

Two Minute Papers

Summary

This video discusses how DeepMind's Gemma 4, a remarkably small AI model, has revolutionized AI's ability to perceive the world. Unlike traditional large models that require separate networks for different senses, Gemma 4 directly integrates visual and audio data into its main transformer. This unique architecture allows it to learn to 'see' and 'hear' efficiently, making it incredibly smart and compact enough to run on a laptop. The video emphasizes the importance and value of such open-source models, highlighting their contribution to the scientific community and the need for continued support.

Chapters

  1. 0:00The Challenge of Large AI Models
  2. 0:30Introducing DeepMind's Gemma 4
  3. 0:50Gemma 4's Unbelievable Size and Capabilities
  4. 1:09DeepMind Reveals Gemma 4's Secret Architecture
  5. 1:48How Conventional AI Processes Sensory Data
  6. 2:29Gemma 4's Innovative Image Processing
  7. 2:47The Unified Approach to Vision and Audio
  8. 3:08Gemma 4 Learns to See, Hear, and Think
  9. 3:14Impact of Gemma 4's Architectural Idea
  10. 3:40Gemma 4 Ecosystem Improvements
  11. 3:52Gemma 4's Influence on Other AI Systems
  12. 4:06The Importance of Open Models
  13. 4:26Supporting Open Model Developers
  14. 4:47Lambda for AI Research and Development
  15. 5:16Call to Action for Lambda AI

Topics covered

  • The Challenge of Large AI Models
  • Introduction of DeepMind's Gemma 4

+5 more topics (full content when you follow the channel)

Transcript excerpt

Finally, something amazing happened. You see, today AI models have become almost comically large. Some of the biggest open and free AI models, like DeepSeek, reached over 1.6 trillion parameters in size. And that's not even the biggest one. So, these cost hundreds of thousands of dollars to run. And then, you find out something crazy. You show them an image and you ask, "What does this image depict?" And you will be surprised to hear the answer. It doesn't know. Yes, it cannot see. Now, what if I told you that they promised you a model that is 99% smaller, a speck of dust comparatively, and yet this tiny guy can see? That sounds impossible. Yes, maybe in our dreams, wishful thinking. But, it actually exists. It is made by DeepMind and is called Gemma 4. This runs on your laptop. It is an absolute gem. Free and open, downloaded more than 300 million times by us fellow scholars. That is in…