I Built A Tool To Detect AI Video (You Can Have It)
Matt Wolfe
Summary
The creator attempts to build a reliable AI video detector to combat the overwhelming amount of AI-generated content (slop) circulating on social media. Using various iterations of AI models like Gemini and Astra, they build a tool that integrates the SiteEngine API. Despite technical hurdles, high API costs, and inconsistent detection accuracy, the creator successfully develops a functional local application that distinguishes between authentic videos and AI-generated ones. Ultimately, the project highlights the current limitations of major AI models in identifying synthetic media, leading the creator to question the reality of the AGI narrative.
Chapters
- 0:00Defining the AI slop problem
- 0:52Project plan and feasibility check
- 1:20Consulting ChatGPT for architectural planning
- 2:59Initial coding with ChatGPT Codex
- 3:35Building the first detector interface
- 4:25Testing against real-world AI clips
- 5:33Troubleshooting detection logic with GPT-6 Astra
- 6:57Integrating the SiteEngine API
- 7:45Optimizing the code with environment variables
- 9:43Addressing high false-negative rates
- 11:52Refining the detector for higher accuracy
- 14:28Minimalist design implementation
- 16:37GitHub repository for local use
- 17:10Philosophical skepticism regarding AGI
- 19:24Final summary and channel outro
Topics covered
- The proliferation of AI-generated video content
- Initial strategy using Google Gemini models
+4 more topics (full content when you follow the channel)
Transcript excerpt
We've got a problem. And I know you've got the problem, I've got the problem, [music] we've all got this problem. AI video slop is everywhere. Not a day goes by where I don't have like my parents or like one of my friends or they my producer sending me a video saying, "Hey, look at this cool thing that somebody just invented." [music] And I watch the video, I go, "Dude, that is not real. Like seriously, you thought that was real?" And I'll be honest, I've been fooled. Like I get videos and I'll watch it like two or three times before my brain [music] clicks like, "Wait a second, I think that might be an AI video." And you know what? I don't want to deal with that anymore. I want to make something that if somebody's going to send me a video, I'll say, "Hey, go to this place first, plug in the link you're about to send me, and if it says it's AI, you know, you don't have to send it to me."…