Google stopped brute-forcing video frame by frame. Gemini agentic video understanding is now live in Gemini 3.7 Flash, 3.6 Flash and 3.5 Flash-Lite, cutting token use by up to 88%, cost by up to 66%, and lifting accuracy by up to 7% on standard benchmarks, according to Deepmind.
It's available today via the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform for video uploads and YouTube videos. There is no exploit or attacker requirement here. The change is architectural, toggled by setting processing to "agentic" at standard token pricing.
How it actually works
Static processing ingests video at a fixed 1 FPS, which wastes tokens on long form and misses fast action. Agentic mode puts Gemini in a loop, deciding what to watch, at what speed, and in which modality, frames, audio or transcript, then pulling only the needed segments with native video tools.
Think of it like a researcher scrubbing a three hour recording instead of transcribing every second. That is how it nails sub-second moment retrieval, needle-in-a-haystack search and rapid motion counting without scanning everything, a step beyond the earlier Gemini Omni 1.1 Flash push for controllable video generation.
Why it matters, and what still needs testing
For builders, this collapses the long-form tradeoff between cost and recall. Multi-hour lectures, how-to guides and surveillance feeds become searchable without million-token bills, and precise counting and anomaly detection improve because the model can resample interesting windows at higher FPS.