English
Related papers

Related papers: Understanding Depth and Height Perception in Large…

200 papers

Multimodal large language models (MLLMs) have made significant progress in integrating visual and linguistic understanding. Existing benchmarks typically focus on high-level semantic capabilities, such as scene understanding and visual…

Computation and Language · Computer Science 2025-02-18 Shangyu Xing , Changhao Xiang , Yuteng Han , Yifan Yue , Zhen Wu , Xinyu Liu , Zhangtai Wu , Fei Zhao , Xinyu Dai

Geometric ability is a significant challenge for large language models (LLMs) due to the need for advanced spatial comprehension and abstract thinking. Existing datasets primarily evaluate LLMs on their final answers, but they cannot truly…

Computation and Language · Computer Science 2025-02-24 Xiaofeng Wang , Yiming Wang , Wenhong Zhu , Rui Wang

Large language models have shown impressive results for multi-hop mathematical reasoning when the input question is only textual. Many mathematical reasoning problems, however, contain both text and image. With the ever-increasing adoption…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Mehran Kazemi , Hamidreza Alvari , Ankit Anand , Jialin Wu , Xi Chen , Radu Soricut

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

Understanding geometry relies heavily on vision. In this work, we evaluate whether state-of-the-art vision language models (VLMs) can understand simple geometric concepts. We use a paradigm from cognitive science that isolates visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Eliza Kosoy , Annya Dahmani , Andrew K. Lampinen , Iulia M. Comsa , Soojin Jeong , Ishita Dasgupta , Kelsey Allen

Large Vision Language Models (LVLMs) have achieved remarkable performance in various vision-language tasks. However, it is still unclear how accurately LVLMs can perceive visual information in images. In particular, the capability of LVLMs…

Computation and Language · Computer Science 2025-07-15 Ryo Kamoi , Yusen Zhang , Sarkar Snigdha Sarathi Das , Ranran Haoran Zhang , Rui Zhang

Large vision language models (LVLM) are the leading A.I approach for achieving a general visual understanding of the world. Models such as GPT, Claude, Gemini, and LLama can use images to understand and analyze complex visual scenes. 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Sagi Eppel

Vision-Language Models (VLMs) excel at 2D tasks such as grounding and captioning, yet remain limited in 3D understanding. A key limitation is their text-only supervision paradigm, which under-constrains fine-grained visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hanxun Yu , Xuan Qu , Yuxin Wang , Jianke Zhu , Lei Ke

Current Large Multimodal Models (LMMs) in Earth Observation typically neglect the critical "vertical" dimension, limiting their reasoning capabilities in complex remote sensing geometries and disaster scenarios where physical spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Xuran Hu , Zhitong Xiong , Zhongcheng Hong , Yifang Ban , Xiaoxiang Zhu , Wufan Zhao

While vision language models (VLMs) excel in 2D semantic visual understanding, their ability to quantitatively reason about 3D spatial relationships remains under-explored, due to the deficiency of 2D images' spatial representation ability.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Pingyi Chen , Yujing Lou , Shen Cao , Jinhui Guo , Lubin Fan , Yue Wu , Lin Yang , Lizhuang Ma , Jieping Ye

Multi-modal Large Language Models (MLLMs) have advanced greatly in general tasks. However, they still face challenges in geometric reasoning, a task that requires synergistic integration of visual recognition proficiency and complex…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zhihao Li , Yao Du , Yang Liu , Yan Zhang , Yufang Liu , Mengdi Zhang , Xunliang Cai , Charles Ling , Boyu Wang

Advancing towards artificial superintelligence requires rich and intelligent perceptual capabilities. A critical frontier in this pursuit is overcoming the limited spatial understanding of Multimodal Large Language Models (MLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Ruiheng Liu , Haihong Hao , Mingfei Han , Xin Gu , Kecheng Zhang , Changlin Li , Xiaojun Chang

In cognitive science and AI, a longstanding question is whether machines learn representations that align with those of the human mind. While current models show promise, it remains an open question whether this alignment is superficial or…

Neurons and Cognition · Quantitative Biology 2025-10-27 Craig Sanders , Billy Dickson , Sahaj Singh Maini , Robert Nosofsky , Zoran Tiganj

Geolocation is now a vital aspect of modern life, offering numerous benefits but also presenting serious privacy concerns. The advent of large vision-language models (LVLMs) with advanced image-processing capabilities introduces new risks,…

Cryptography and Security · Computer Science 2024-08-20 Yi Liu , Junchen Ding , Gelei Deng , Yuekang Li , Tianwei Zhang , Weisong Sun , Yaowen Zheng , Jingquan Ge , Yang Liu

The development of Large Vision-Language Models (LVLMs) is striving to catch up with the success of Large Language Models (LLMs), yet it faces more challenges to be resolved. Very recent works enable LVLMs to localize object-level visual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Zhipeng Huang , Zhizheng Zhang , Zheng-Jun Zha , Yan Lu , Baining Guo

Large Language Models (LLMs) are increasingly deployed in applications that interact with the physical world, such as navigation, robotics, or mapping, making robust geospatial reasoning a critical capability. Despite that, LLMs' ability to…

Artificial Intelligence · Computer Science 2026-02-19 Thinh Hung Truong , Jey Han Lau , Jianzhong Qi

Visual grounding, localizing objects from natural language descriptions, represents a critical bridge between language and vision understanding. While multimodal large language models (MLLMs) achieve impressive scores on existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Rang Li , Lei Li , Shuhuai Ren , Hao Tian , Shuhao Gu , Shicheng Li , Zihao Yue , Yudong Wang , Wenhan Ma , Zhe Yang , Jingyuan Ma , Zhifang Sui , Fuli Luo

Shapes and textures are the basic building blocks of visual perception. The ability to identify shapes regardless of orientation, texture, or context, and to recognize textures and materials independently of their associated objects, is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Sagi Eppel , Mor Bismut , Alona Faktor-Strugatski

Large language models (LLMs) have shown remarkable proficiency in human-level reasoning and generation capabilities, which encourages extensive research on their application in mathematical problem solving. However, current work has been…

Computation and Language · Computer Science 2025-08-21 Jiahui Gao , Renjie Pi , Jipeng Zhang , Jiacheng Ye , Wanjun Zhong , Yufei Wang , Lanqing Hong , Jianhua Han , Hang Xu , Zhenguo Li , Lingpeng Kong

Understanding perspective is fundamental to human visual perception, yet the extent to which multimodal large language models (MLLMs) internalize perspective geometry remains unclear. We introduce MMPerspective, the first benchmark…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yolo Y. Tang , Pinxin Liu , Zhangyun Tan , Mingqian Feng , Rui Mao , Chao Huang , Jing Bi , Yunzhong Xiao , Susan Liang , Hang Hua , Ali Vosoughi , Luchuan Song , Zeliang Zhang , Chenliang Xu
‹ Prev 1 2 3 10 Next ›