中文
相关论文

相关论文: Open-o3-Video: Grounded Video Reasoning with Expli…

200 篇论文

Recent video reasoning models increasingly produce spatio-temporal evidence chains that localize objects at specific timestamps. While these traces improve interpretability by grounding \emph{where} and \emph{when} evidence appears, they…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Bishoy Galoaa , Shayda Moezzi , Xiangyu Bai , Sarah Ostadabbas

In long-video understanding, conventional uniform frame sampling often fails to capture key visual evidence, leading to degraded performance and increased hallucinations. To address this, recent agentic thinking-with-videos paradigms have…

Video grounding aims to localize a spatio-temporal section in a video corresponding to an input text query. This paper addresses a critical limitation in current video grounding methodologies by introducing an Open-Vocabulary…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Syed Talal Wasim , Muzammal Naseer , Salman Khan , Ming-Hsuan Yang , Fahad Shahbaz Khan

Recent advances in large multimodal models have leveraged image-based tools with reinforcement learning to tackle visual problems. However, existing open-source approaches often exhibit monotonous reasoning patterns and allow only a limited…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Xin Lai , Junyi Li , Wei Li , Tao Liu , Tianjian Li , Hengshuang Zhao

Spatio-temporal video grounding (STVG) requires localizing a target object in untrimmed videos both temporally and spatially from natural language descriptions. Despite their strong language understanding, multimodal large language models…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Xin Gu , Haoji Zhang , Qihang Fan , Jingxuan Niu , Zhipeng Zhang , Libo Zhang , Guang Chen , Fan Chen , Longyin Wen , Sijie Zhu

Existing multimodal large language models for long-video understanding predominantly rely on uniform sampling and single-turn inference, limiting their ability to identify sparse yet critical evidence amid extensive redundancy. We introduce…

Models like OpenAI-o3 pioneer visual grounded reasoning by dynamically referencing visual regions, just like human "thinking with images". However, no benchmark exists to evaluate these capabilities holistically. To bridge this gap, we…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Haochen Wang , Xiangtai Li , Zilong Huang , Anran Wang , Jiacong Wang , Tao Zhang , Jiani Zheng , Sule Bai , Zijian Kang , Jiashi Feng , Zhuochen Wang , Zhaoxiang Zhang

Multimodal Large Language Models (MLLMs) have shown impressive performance on vision-language tasks, but their long Chain-of-Thought (CoT) capabilities in multimodal scenarios remain underexplored. Inspired by OpenAI's o3 model, which…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Ye Wang , Qianglong Chen , Zejun Li , Siyuan Wang , Shijie Guo , Zhirui Zhang , Zhongyu Wei

Physical video understanding requires more than naming an event correctly. A model can answer a question about pouring, sliding, or collision from textual regularities while still failing to localize the event in time or space. We introduce…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Alibay Osmanli , Zixu Cheng , Shaogang Gong

Human processes video reasoning in a sequential spatio-temporal reasoning logic, we first identify the relevant frames ("when") and then analyse the spatial relationships ("where") between key objects, and finally leverage these…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Zixu Cheng , Jian Hu , Ziquan Liu , Chenyang Si , Wei Li , Shaogang Gong

Recent progress in Multimodal Large Language Models (MLLMs) has demonstrated strong semantic understanding capabilities, but struggles to perform precise spatio-temporal understanding. Existing spatio-temporal methods primarily focus on the…

Currently, utilizing large language models to understand the 3D world is becoming popular. Yet existing 3D-aware LLMs act as black boxes: they output bounding boxes or textual answers without revealing how those decisions are made, and they…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Zhihao Yuan , Shuyi Jiang , Chun-Mei Feng , Yaolun Zhang , Shuguang Cui , Zhen Li , Na Zhao

Cause-and-effect reasoning in video is a significant challenge for Vision-Language Models (VLMs), as it requires going beyond surface-level perception to a deeper understanding of causal mechanisms. However, existing benchmarks rarely…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Mingfang Zhang , Jingjing Pan , Ashutosh Kumar , Rajat Saini , Mustafa Erdogan , Hsuan-Kung Yang , Caixin Kang , Yifei Huang , Yoichi Sato , Quan Kong

Recent video multimodal large language models achieve impressive results across various benchmarks. However, current evaluations suffer from two critical limitations: (1) inflated scores can mask deficiencies in fine-grained visual…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Jiahao Meng , Tan Yue , Qi Xu , Haochen Wang , Zhongwei Ren , Weisong Liu , Yuhao Wang , Renrui Zhang , Yunhai Tong , Haodong Duan

Recent advances in Multi-modal Large Language Models (MLLMs) have showcased remarkable capabilities in vision-language understanding. However, enabling robust video spatial reasoning-the ability to comprehend object locations, orientations,…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Haoran Tang , Meng Cao , Ruyang Liu , Xiaoxi Liang , Linglong Li , Ge Li , Xiaodan Liang

Reasoning over dynamic visual content remains a central challenge for multimodal large language models. Recent thinking models generate explicit reasoning traces for interpretability; however, their reasoning often appears convincing while…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Muhammad Maaz , Hanoona Rasheed , Fahad Shahbaz Khan , Salman Khan

Video spatial reasoning requires accumulating viewpoint-dependent evidence over time while retaining information useful to the question being asked. Existing spatial video-language models improve geometric perception and long-range context…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Xianqiang Gao , Qizhi Chen , Delin Qu , Haoming Song , Zhigang Wang , Bin Zhao , Dong Wang , Xuelong Li

Temporal Video Grounding (TVG), which requires pinpointing relevant temporal segments from video based on language query, has always been a highly challenging task in the field of video understanding. Videos often have a larger volume of…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Feng Yue , Zhaoxing Zhang , Junming Jiao , Zhengyu Liang , Shiwen Cao , Feifei Zhang , Rong Shen

Video Question Answering (VideoQA) task serves as a critical playground for evaluating whether foundation models can effectively perceive, understand, and reason about dynamic real-world scenarios. However, existing Multimodal Large…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Sunqi Fan , Jiashuo Cui , Meng-Hao Guo , Shuojin Yang

Multi-video event understanding demands models that can locate and attribute query-relevant evidence scattered across long, heterogeneous video corpora. Existing large vision-language models (LVLMs) often underperform in this regime because…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Pengyu Yan , Akhil Gorugantu , Mahesh Bhosale , Abdul Wasi , Vishvesh Trivedi , David Doermann
‹ 上一页 1 2 3 10 下一页 ›