English
Related papers

Related papers: Geo3DVQA: Evaluating Vision-Language Models for 3D…

200 papers

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

Vision-Language Models (VLMs) excel at 2D tasks such as grounding and captioning, yet remain limited in 3D understanding. A key limitation is their text-only supervision paradigm, which under-constrains fine-grained visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hanxun Yu , Xuan Qu , Yuxin Wang , Jianke Zhu , Lei Ke

In recent years, 2D Vision-Language Models (VLMs) have made significant strides in image-text understanding tasks. However, their performance in 3D spatial comprehension, which is critical for embodied intelligence, remains limited. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhangyang Qi , Zhixiong Zhang , Ye Fang , Jiaqi Wang , Hengshuang Zhao

3D Visual Grounding (3DVG) is a critical bridge from vision-language perception to robotics, requiring both language understanding and 3D scene reasoning. Traditional supervised models leverage explicit 3D geometry but exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Seongmin Jung , Seongho Choi , Gunwoo Jeon , Minsu Cho , Jongwoo Lim

Vision-Language Models (VLMs) are known to struggle with spatial reasoning and visual alignment. To help overcome these limitations, we introduce iVISPAR, an interactive multimodal benchmark designed to evaluate the spatial reasoning…

Computation and Language · Computer Science 2025-10-01 Julius Mayer , Mohamad Ballout , Serwan Jassim , Farbod Nosrat Nezami , Elia Bruni

Recently, Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) have shown promise in instruction following and 2D image understanding. While these models are powerful, they have not yet been developed to comprehend the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Senqiao Yang , Jiaming Liu , Ray Zhang , Mingjie Pan , Zoey Guo , Xiaoqi Li , Zehui Chen , Peng Gao , Yandong Guo , Shanghang Zhang

Earth vision has achieved milestones in geospatial object recognition but lacks exploration in object-relational reasoning, limiting comprehensive scene understanding. To address this, a progressive Earth vision-language understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Junjue Wang , Yanfei Zhong , Zihang Chen , Zhuo Zheng , Ailong Ma , Liangpei Zhang

Large language models (LLMs) and vision-language models (VLMs) have demonstrated remarkable performance across a wide range of tasks and domains. Despite this promise, spatial understanding and reasoning -- a fundamental component of human…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Jiayu Wang , Yifei Ming , Zhenmei Shi , Vibhav Vineet , Xin Wang , Yixuan Li , Neel Joshi

Geometric understanding - including depth and height perception - is fundamental to intelligence and crucial for navigating our environment. Despite the impressive capabilities of large Vision Language Models (VLMs), it remains unclear how…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shehreen Azad , Yash Jain , Rishit Garg , Yogesh S Rawat , Vibhav Vineet

Effectively understanding urban scenes requires fine-grained spatial reasoning about objects, layouts, and depth cues. However, how well current vision-language models (VLMs), pretrained on general scenes, transfer these abilities to urban…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Juneyoung Ro , Namwoo Kim , Yoonjin Yoon

As textual reasoning with large language models (LLMs) has advanced significantly, there has been growing interest in enhancing the multimodal reasoning capabilities of large vision-language models (LVLMs). However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Junfei Wu , Jian Guan , Kaituo Feng , Qiang Liu , Shu Wu , Liang Wang , Wei Wu , Tieniu Tan

Reasoning segmentation has recently expanded from ground-level scenes to remote-sensing imagery, yet UAV data poses distinct challenges, including oblique viewpoints, ultra-high resolutions, and extreme scale variations. To address these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Shuyan Ke , Yifan Mei , Changli Wu , Yonghan Zheng , Jiayi Ji , Liujuan Cao , Rongrong Ji

Visual Language Models (VLMs) are essential for various tasks, particularly visual reasoning tasks, due to their robust multi-modal information integration, visual reasoning capabilities, and contextual awareness. However, existing \VLMs{}'…

Computation and Language · Computer Science 2024-09-13 Zaiqiao Meng , Hao Zhou , Yifang Chen

This review provides a systematic analysis of comprehensive survey of 3D object detection with vision-language models(VLMs) , a rapidly advancing area at the intersection of 3D vision and multimodal AI. By examining over 100 research…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Ranjan Sapkota , Konstantinos I Roumeliotis , Rahul Harsha Cheppally , Marco Flores Calero , Manoj Karkee

Vision language models (VLMs) achieve unified modeling of images and text, enabling them to accomplish complex real-world tasks through perception, planning, and reasoning. Among these tasks, reasoning is particularly representative, with…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Fan Yuan , Yuchen Yan , Yifan Jiang , Haoran Zhao , Tao Feng , Jinyan Chen , Yanwei Lou , Wenqi Zhang , Yongliang Shen , Weiming Lu , Jun Xiao , Yueting Zhuang

Current Vision-Language Models (VLMs) fail at quantitative spatial reasoning because their architectures destroy pixel-level information required for counting and measurements. Vision encoders compress images through patch embeddings,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Peter A. Massih , Eric Cosatto

Current Large Language Models have achieved Olympiad-level logic, yet Vision-Language Models paradoxically falter on elementary spatial tasks like block counting. This capability mismatch reveals a critical ``spatial intelligence gap,''…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Shaoxiong Zhan , Yanlin Lai , Zheng Liu , Hai Lin , Shen Li , Xiaodong Cai , Zijian Lin , Wen Huang , Hai-Tao Zheng

3D Large Language Models (LLMs) leveraging spatial information in point clouds for 3D spatial reasoning attract great attention. Despite some promising results, the advantages of point clouds over other modalities remain unclear. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Weichen Zhang , Ruiying Peng , Xin Zeng , Jianjie Fang , Ziyou Wang , Kaiyuan Li , Heng Dong , Wei Li , Chen Gao , Xin Wang , Xinlei Chen , Yong Li

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across diverse tasks, garnering significant attention in AI communities. However, their performance and reliability in specialized domains…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yang Nan , Huichi Zhou , Xiaodan Xing , Guang Yang

Vision-Language Models (VLMs) in remote sensing often fail at complex analytical tasks, a limitation stemming from their end-to-end training paradigm that bypasses crucial reasoning steps and leads to unverifiable outputs. To address this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Jiaqi Liu , Lang Sun , Ronghao Fu , Bo Yang
‹ Prev 1 4 5 6 7 8 10 Next ›