introducing agentic video understanding with Gemini
instead of using static processing (ingesting media at a fixed frame rate), the model can now take an active, goal-directed role in determining what to watch, at what speed, and through which modality (frames, audio, or transcript), fetching only the moments and signals needed
this new approach cuts costs by up to 66% and reduces token consumption by up to 88% while boosting accuracy
available now via the Gemini API and in AI Studio: http://ai.studio
