中文
相关论文

相关论文: CamReasoner: Reinforcing Camera Movement Understan…

200 篇论文

Reasoning Segmentation (RS) aims to delineate objects based on implicit text queries, the interpretation of which requires reasoning and knowledge integration. Unlike the traditional formulation of segmentation problems that relies on fixed…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Yiqing Shen , Chenjia Li , Fei Xiong , Jeong-O Jeong , Tianpeng Wang , Michael Latman , Mathias Unberath

Recent multimodal large language models (MLLMs) have advanced video understanding, yet most still "think about videos" ie once a video is encoded, reasoning unfolds entirely in text, treating visual input as a static context. This passive…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Hanoona Rasheed , Mohammed Zumri , Muhammad Maaz , Ming-Hsuan Yang , Fahad Shahbaz Khan , Salman Khan

Humans build viewpoint-independent cognitive maps through navigation, enabling intuitive reasoning about object permanence and spatial relations. We argue that multimodal large language models (MLLMs), despite extensive video training, lack…

机器学习 · 计算机科学 2025-12-02 Jacob Thompson , Emiliano Garcia-Lopez , Yonatan Bisk

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

Recent progress in generative video models, such as Veo-3, has shown surprising zero-shot reasoning abilities, creating a growing need for systematic and reliable evaluation. We introduce V-ReasonBench, a benchmark designed to assess video…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Yang Luo , Xuanlei Zhao , Baijiong Lin , Lingting Zhu , Liyao Tang , Yuqi Liu , Ying-Cong Chen , Shengju Qian , Xin Wang , Yang You

Chain-of-thought reasoning has significantly improved the performance of Large Language Models (LLMs) across various domains. However, this reasoning process has been confined exclusively to textual space, limiting its effectiveness in…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Haozhe Wang , Alex Su , Weiming Ren , Fangzhen Lin , Wenhu Chen

Remote sensing imagery presents vast, inherently unstructured spatial data, necessitating sophisticated reasoning to interpret complex user intents and contextual relationships beyond simple recognition tasks. In this paper, we aim to…

计算机视觉与模式识别 · 计算机科学 2025-12-24 Liang Yao , Fan Liu , Hongbo Lu , Chuanyi Zhang , Rui Min , Shengxiang Xu , Shimin Di , Pai Peng

What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space-time, and iteratively transform these…

计算机视觉与模式识别 · 计算机科学 2020-04-14 Thao Minh Le , Vuong Le , Svetha Venkatesh , Truyen Tran

Multi-modal language models (LM) have recently shown promising performance in high-level reasoning tasks on videos. However, existing methods still fall short in tasks like causal or compositional spatiotemporal reasoning over actions, in…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Apratim Bhattacharyya , Sunny Panchal , Mingu Lee , Reza Pourreza , Pulkit Madan , Roland Memisevic

Large Language Models (LLMs) and Vision Language Models (VLMs) have shown impressive reasoning abilities, yet they struggle with spatial understanding and layout consistency when performing fine-grained visual editing. We introduce a…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Haoyu Zhen , Xiaolong Li , Yilin Zhao , Han Zhang , Sifei Liu , Kaichun Mo , Chuang Gan , Subhashree Radhakrishnan

Spatial reasoning is a core aspect of human intelligence that allows perception, inference and planning in 3D environments. However, current vision-language models (VLMs) struggle to maintain geometric coherence and cross-view consistency…

人工智能 · 计算机科学 2025-12-03 Qiyao Xue , Weichen Liu , Shiqi Wang , Haoming Wang , Yuyang Wu , Wei Gao

Reasoning about spatial relationships between objects is essential for many real-world robotic tasks, such as fetch-and-delivery, object rearrangement, and object search. The ability to detect and disambiguate different objects and identify…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Negar Nejatishahidin , Madhukar Reddy Vongala , Jana Kosecka

Vision-Language Models (VLMs) achieve strong performance on spatial question answering benchmarks, yet it remains unclear whether such gains reflect genuine spatial intelligence. We show that existing spatial VLMs lack basic camera motion…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Hsiang-Wei Huang , Junbin Lu , Kuang-Ming Chen , Jianxu Shangguan , Cheng-Yen Yang , Jenq-Neng Hwang

Long video understanding is still challenging for recent Large Video-Language Models (LVLMs) due to the conflict between long-form temporal understanding and detailed spatial perception. LVLMs with a uniform frame sampling mechanism, which…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Shenghao Fu , Qize Yang , Yuan-Ming Li , Xihan Wei , Xiaohua Xie , Wei-Shi Zheng

Spatio-physical reasoning, a foundation capability for understanding the real physics world, is a critical step towards building robust world models. While recent vision language models (VLMs) have shown remarkable progress in specialized…

计算机视觉与模式识别 · 计算机科学 2025-08-15 Tiancheng Han , Yunfei Gao , Yong Li , Wuzhou Yu , Qiaosheng Zhang , Wenqi Shao

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Reasoning over dynamic visual content remains a central challenge for multimodal large language models. Recent thinking models generate explicit reasoning traces for interpretability; however, their reasoning often appears convincing while…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Muhammad Maaz , Hanoona Rasheed , Fahad Shahbaz Khan , Salman Khan

The ability to understand and reason about spatial relationships between objects in images is an important component of visual reasoning. This skill rests on the ability to recognize and localize objects of interest and determine their…

计算与语言 · 计算机科学 2024-10-14 Navid Rajabi , Jana Kosecka

Large language models (LLMs) and multimodal large language models (MLLMs) have significantly advanced artificial intelligence. However, visual reasoning, reasoning involving both visual and textual inputs, remains underexplored. Recent…

计算机视觉与模式识别 · 计算机科学 2025-04-18 I-Sheng Fang , Jun-Cheng Chen

Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language tasks, but they continue to struggle with spatial understanding. Existing spatial MLLMs often rely on explicit 3D inputs or architecture-specific…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Hunar Batra , Haoqin Tu , Hardy Chen , Yuanze Lin , Cihang Xie , Ronald Clark