LIVE
Into the Omniverse: How Open World Models Push the Frontier of Physical AI06/08/26 · NVIDIA|The Download: Google’s AI shake-up and Meta’s rogue model06/08/26 · Google|Beating GPT-5.6 Sol on retrieval with 100x cheaper open models05/08/26 · OpenAI|Argus: A General-Purpose Agentic Runtime for Long-Horizon Reasoning05/08/26 · OpenAI|Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist Domains05/08/26 · NVIDIA|I’m leaving OpenAI to build telepathy05/08/26 · OpenAI|Changes at Google DeepMind: Demis Hassabis from CEO to Chair, Jeff Dean departs05/08/26 · Google|Third-party cyber evaluations involving OpenAI models04/08/26 · OpenAI|Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent04/08/26 · OpenAI|Mistral's Shieldstral: 3B open-weights model for multimodal moderation04/08/26 · Mistral AI|NVIDIA Joins NSF State and Regional AI Hubs Program to Expand AI Research and Education Across the US04/08/26 · NVIDIA|Apple says more ex-employees may have taken confidential data to OpenAI04/08/26 · OpenAI|Into the Omniverse: How Open World Models Push the Frontier of Physical AI06/08/26 · NVIDIA|The Download: Google’s AI shake-up and Meta’s rogue model06/08/26 · Google|Beating GPT-5.6 Sol on retrieval with 100x cheaper open models05/08/26 · OpenAI|Argus: A General-Purpose Agentic Runtime for Long-Horizon Reasoning05/08/26 · OpenAI|Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist Domains05/08/26 · NVIDIA|I’m leaving OpenAI to build telepathy05/08/26 · OpenAI|Changes at Google DeepMind: Demis Hassabis from CEO to Chair, Jeff Dean departs05/08/26 · Google|Third-party cyber evaluations involving OpenAI models04/08/26 · OpenAI|Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent04/08/26 · OpenAI|Mistral's Shieldstral: 3B open-weights model for multimodal moderation04/08/26 · Mistral AI|NVIDIA Joins NSF State and Regional AI Hubs Program to Expand AI Research and Education Across the US04/08/26 · NVIDIA|Apple says more ex-employees may have taken confidential data to OpenAI04/08/26 · OpenAI|
ResearchOpenAI

Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent

We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web exploration. Preliminary evaluations reveal two…

August 4, 20261 min readPublished byarXiv

We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web exploration. Preliminary evaluations reveal two critical bottlenecks in current models: (1) modality bias, where agents bypass visual tools in favor of textual search, and (2) parametric knowledge leakage, where models rely on internal memory rather than genuine tool-augmented execution. To address these challenges, we propose Video-DR, featuring a decoupled perception-exploration pipeline with stage-wise tool unlocking that compels exhaustive cross-frame visual grounding prior to web retrieval. Our framework adopts a two-stage training recipe: supervised fine-tuning followed by Group Relative Policy Optimization (GRPO), enabling autonomous exploration that breaks the imitation-learning ceiling. Furthermore, we curate Video-DR-Bench, a human-AI collaborative benchmark comprising 200 complex, multi-hop VQA instances. Empirical results demonstrate that our Video-DeepResearch-35B-A3B establishes a new state-of-the-art of 64.0% average accuracy, surpassing proprietary Claude-4.5-Sonnet (59.0%) by 5.0 points and significantly outperforming GPT-5 (52.5%) and Gemini 2.5 Pro (57.5%). The 30B-A3B variant achieves 59.3%, competitive with Claude-4.5-Sonnet and demonstrating the effectiveness of our training paradigm even at compact scale. Code: https://github.com/Osilly/Vision-DeepResearch.

Tags
multimodalagentsragcodingbenchmark

Read also