Naveen Rao: 4D Computing, AI's Energy Wall & Beating Biology
All-In Podcast
Summary
Naveen Rao explores the critical energy limitations currently facing the AI industry. He argues that modern von Neumann computing architectures are inherently inefficient for AI because they consume most of their energy moving data rather than processing it. To solve this, his company, Unconventional AI, is developing 'dynamical computers' that fuse memory and computation at the physical level, inspired by the energy efficiency of biological brains. Rao discusses the technical transition from digital abstractions to physical dynamical systems, the successful testing of their first chip, and the long-term vision of enabling massive-scale intelligence with 1000x better power efficiency.
Chapters
- 0:00Introduction to Unconventional AI
- 1:37Professional background and early motivation
- 2:59Evolution of AI infrastructure
- 4:46The energy consumption crisis
- 7:11Biology as an efficiency benchmark
- 8:19The inefficiency of information movement
- 10:27Limitations of digital abstractions
- 11:46Applying dynamical systems theory
- 12:06The metronome synchronization experiment
- 13:15Developing the Uno image generation model
- 14:48Leveraging sparsity in computing
- 15:35The world's first dynamical computer
- 17:20The 4D computing paradigm
- 19:10Future market and Jevons paradox
- 20:06Path to a commercial product
Topics covered
- Energy crisis in AI infrastructure
- Biological efficiency vs current hardware
+6 more topics (full content when you follow the channel)
Transcript excerpt
Naveen Rao, co-founder and CEO of Unconventional AI, which is an AI chip startup. >> Best known for building and [music] selling two deep tech companies. >> Naveen is kind of definitionally outlier founder. >> When I came there, we had about a $20 million business and it was, you know, 7 or 800 million [music] when I left. >> think you really understand something until you can build it. >> Just because something is tried does not mean it's wrong. [music] >> I'm the opposite of an AI doomer. I think AI is the next evolution of humanity. >> We need innovation on the hardware substrate to actually build true intelligence. >> Please welcome Naveen Rao. >> [music] >> Everyone, great to be here. Um, you know, switching gears a little bit to AI now, which you may have heard a little bit about. Um, I it's super exciting to be at this conference specifically because, as was said in the intro, I'm…