Open Models Change The Economics of AI

Y Combinator

Summary

This video features an in-depth conversation with Jeffrey Morgan, CEO of Olama, exploring how open-source AI models are transforming the enterprise landscape. The discussion covers the rapid shift toward open models for cost efficiency, customization, and control, as well as the technical challenges of orchestrating these models at scale. Morgan explains how the ecosystem is moving toward a hybrid approach, where developers combine local models with cloud-hosted ones to achieve best-in-breed results. Throughout the episode, he shares insights into the evolution of AI infrastructure, the importance of building developer-centric tools, and the future of open versus frontier closed models.

Chapters

  1. 0:00Solving enterprise pain points
  2. 0:05Customization as a north star
  3. 1:19The Strategic Shift to Open Models
  4. 3:03Use cases in the enterprise
  5. 3:07The Rise of Coding Agents
  6. 3:22Automating non-developer workflows
  7. 4:39Token usage explosion
  8. 8:55Operating at Scale and Hardware
  9. 9:01Day zero launch management
  10. 14:11Unbundling the stack
  11. 14:24The role of system architecture
  12. 15:34The Future Stack: Orchestration
  13. 18:19The Economics of AI Development
  14. 22:33Local model feasibility
  15. 25:54The hardware renaissance
  16. 30:30Flash model efficiency
  17. 33:48Geopolitics and security
  18. 36:51Founder Journey and Lessons
  19. 42:50Navigating the pivot
  20. 49:59The YC influence
  21. 55:05Breaking old infrastructure rules

Topics covered

  • The Rise of Open Models
  • Economic Drivers for Enterprises

+4 more topics (full content when you follow the channel)

Transcript excerpt

cost is by far the largest pain point that open models can jump in and solve. But you know, every business has a vision of getting better control over AI and customizing it for their business. And that's really their north star. You know, cost is something they can solve in the short term, but it then enables them to then go and and customize these models for their unique use case. >> Early 2024, there was lots of interest in fine-tuning your own custom models. Then it sort of went away and all of that it will just be wasted effort. it'll get stomped by the next model release. Seems like it's coming back now. You have a front seat to all of it. Do you think we're going through like another cycle or is it here to stay this time? [music] Welcome back to another episode of the Lite Cone. Today we're talking to Jeffrey Morgan, co-founder and CEO of Olama, the easiest way to run open source A…