Agents at Scale: Inside MiniMax's Model and the Infrastructure Behind It — Olive Song

AI Engineer

Summary

Este vídeo presenta una conversación con Dan de Together AI y Olive de MiniMax, explorando el lanzamiento del modelo de IA MiniMax M3. Se discute la decisión de hacer M3 de código abierto, sus capacidades multimodales y cómo la asociación con Together AI permite su distribución a escala. También se abordan los desafíos de la optimización de la inferencia, la evolución de las cargas de trabajo hacia agentes y modelos multimodales, y cómo se entrena un modelo para tareas complejas. Los expertos comparten sus perspectivas sobre el futuro de la IA, la subutilización de las GPUs y el creciente potencial de los modelos de código abierto.

Chapters

  1. 0:00Introductions and Core Roles
  2. 1:15Why Open Source MiniMax M3
  3. 2:20Together AI's MiniMax Partnership
  4. 3:51MiniMax M3 Unique Capabilities
  5. 7:20Behind the Inference Stack
  6. 9:10Adapting to Agentic Workloads
  7. 11:58Maximizing Inference Performance
  8. 13:46Training Long-Horizon Tasks
  9. 17:32AI's Future and Open Source

Topics covered

  • Roles e Introducciones
  • Filosofía del Código Abierto

+8 more topics (full content when you follow the channel)

Transcript excerpt

This is a discussion that I'm particularly excited about because the field is moving so fast and we have two people that that kind of have this unique vantage point on the field and what I want to do is kind of ask questions to see if we can learn from that. So I want to start off with intros, talk a little bit about your role, what you're thinking about, what you're working on. Maybe Dan if you can go first. >> Uh hey everyone. I'm Dan. I'm the VP of Kernels Together AI. I lead inference, GPU optimization, trying to figure out how to use GPUs most effectively to serve AI models. >> Yeah. So one of the things that I wanted to dive in with Dan about is like you model drops, what are what is everything that goes on behind the scenes to serve it so that everybody here there's a lot of builders here that can use it. Olive I want to throw it over to you to talk about your role and what you're…