English
Related papers

Related papers: Multimodal Spatial Reasoning in the Large Model Er…

200 papers

Spatial cognition is essential for human intelligence, enabling problem-solving through visual simulations rather than solely relying on verbal reasoning. However, existing AI benchmarks primarily assess verbal reasoning, neglecting the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Linjie Li , Mahtab Bigverdi , Jiawei Gu , Zixian Ma , Yinuo Yang , Ziang Li , Yejin Choi , Ranjay Krishna

Unlocking spatial reasoning in Multimodal Large Language Models (MLLMs) is crucial for enabling intelligent interaction with 3D environments. While prior efforts often rely on explicit 3D inputs or specialized model architectures, we ask:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Fangrui Zhu , Hanhui Wang , Yiming Xie , Jing Gu , Tianye Ding , Jianwei Yang , Huaizu Jiang

Multimodal Small-to-Medium sized Language Models (MSLMs) have demonstrated strong capabilities in integrating visual and textual information but still face significant limitations in visual comprehension and mathematical reasoning,…

Machine Learning · Computer Science 2026-01-27 Ashutosh Bajpai , Akshat Bhandari , Akshay Nambi , Tanmoy Chakraborty

Despite impressive advancements in Visual-Language Models (VLMs) for multi-modal tasks, their reliance on RGB inputs limits precise spatial understanding. Existing methods for integrating spatial cues, such as point clouds or depth, either…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Yang Liu , Ming Ma , Xiaomin Yu , Pengxiang Ding , Han Zhao , Mingyang Sun , Siteng Huang , Donglin Wang

Spatial reasoning is an essential problem in embodied AI research. Efforts to enhance spatial reasoning abilities through supplementary spatial data and fine-tuning have proven limited and ineffective when addressing complex embodied tasks,…

Spatial intelligence is crucial for vision--language models (VLMs) in the physical world, yet many benchmarks evaluate largely unconstrained scenes where models can exploit 2D shortcuts. We introduce SSI-Bench, a VQA benchmark for spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Chen Yang , Guanxin Lin , Youquan He , Peiyao Chen , Guanghe Liu , Yufan Mo , Zhouyuan Xu , Linhao Wang , Guohui Zhang , Zihang Zhang , Shenxiang Zeng , Chen Wang , Jiansheng Fan

Large language models (LLMs) have achieved superior performance in powering text-based AI agents, endowing them with decision-making and reasoning abilities akin to humans. Concurrently, there is an emerging research trend focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Junlin Xie , Zhihong Chen , Ruifei Zhang , Xiang Wan , Guanbin Li

The emergence of multimodal large language models (MLLMs) has triggered extensive research in model evaluation. While existing evaluation studies primarily focus on unimodal (vision-only) comprehension and reasoning capabilities, they…

Multimedia · Computer Science 2025-04-24 Xiaocui Yang , Wenfang Wu , Shi Feng , Ming Wang , Daling Wang , Yang Li , Qi Sun , Yifei Zhang , Xiaoming Fu , Soujanya Poria

While multimodal large language models (MLLMs) have made significant strides in natural image understanding, their ability to perceive and reason over hyperspectral image (HSI) remains underexplored, which is a vital modality in remote…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Xinyu Zhang , Zurong Mai , Qingmei Li , Zjin Liao , Yibin Wen , Yuhang Chen , Xiaoya Fan , Chan Tsz Ho , Bi Tianyuan , Haoyuan Liang , Ruifeng Su , Zihao Qian , Juepeng Zheng , Jianxi Huang , Yutong Lu , Haohuan Fu

Large language models (LLMs) have shown emerging potential in spatiotemporal reasoning, making them promising candidates for building urban agents that support diverse urban downstream applications. Despite these benefits, existing studies…

Artificial Intelligence · Computer Science 2025-05-26 Siqi Lai , Yansong Ning , Zirui Yuan , Zhixi Chen , Hao Liu

This paper presents a comprehensive survey of the current status and opportunities for Large Language Models (LLMs) in strategic reasoning, a sophisticated form of reasoning that necessitates understanding and predicting adversary actions…

Computation and Language · Computer Science 2024-04-02 Yadong Zhang , Shaoguang Mao , Tao Ge , Xun Wang , Adrian de Wynter , Yan Xia , Wenshan Wu , Ting Song , Man Lan , Furu Wei

Spatial reasoning is foundational for Vision-Language Models (VLMs), particularly when deployed as Vision-Language-Action (VLA) agents in physical environments. However, existing benchmarks predominantly focus on elementary, single-hop…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Youngwan Lee , Soojin Jang , Yoorhim Cho , Seunghwan Lee , Yong-Ju Lee , Sung Ju Hwang

Multimodal Large Language Models (MLLMs) have become a powerful tool for integrating visual and textual information. Despite their exceptional performance on visual understanding benchmarks, measuring their ability to reason abstractly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Nilay Yilmaz , Maitreya Patel , Yiran Lawrence Luo , Tejas Gokhale , Chitta Baral , Suren Jayasuriya , Yezhou Yang

Spatial Reasoning is an important component of human cognition and is an area in which the latest Vision-language models (VLMs) show signs of difficulty. The current analysis works use image captioning tasks and visual question answering.…

Computation and Language · Computer Science 2025-11-11 Akshar Tumu , Varad Shinde , Parisa Kordjamshidi

Understanding 3D spatial relationships remains a major limitation of current Vision-Language Models (VLMs). Prior work has addressed this issue by creating spatial question-answering (QA) datasets based on single images or indoor videos.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Mohsen Gholami , Ahmad Rezaei , Zhou Weimin , Sitong Mao , Shunbo Zhou , Yong Zhang , Mohammad Akbari

Spatial reasoning is a critical capability for intelligent robots, yet current vision-language models (VLMs) still fall short of human-level performance in video-based spatial reasoning. This gap mainly stems from two challenges: a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Zuntao Liu , Yi Du , Taimeng Fu , Shaoshu Su , Cherie Ho , Chen Wang

Recent 3D Large-Language Models (3D-LLMs) claim to understand 3D worlds, especially spatial relationships among objects. Yet, we find that simply fine-tuning a language model on text-only question-answer pairs can perform comparably or even…

Computation and Language · Computer Science 2026-03-26 Xianzheng Ma , Tao Sun , Shuai Chen , Yash Bhalgat , Jindong Gu , Angel X Chang , Iro Armeni , Iro Laina , Songyou Peng , Victor Adrian Prisacariu

Large language models (LLMs) and vision language models (VLMs), such as DeepSeek R1,OpenAI o3, and Gemini 2.5 Pro, have demonstrated remarkable reasoning capabilities across logical inference, problem solving, and decision making. However,…

Artificial Intelligence · Computer Science 2025-11-19 Xiaoxing Lian , Aidong Yang , Jun Zhu , Peng Wang , Yue Zhang

Recent advances in large language models (LLMs) and vision-language models (LVLMs) have shown promise across many tasks, yet their scientific reasoning capabilities remain untested, particularly in multimodal settings. We present…

Machine Learning · Computer Science 2025-06-03 Xinwu Ye , Chengfan Li , Siming Chen , Wei Wei , Xiangru Tang

Despite their advanced reasoning capabilities, state-of-the-art Multimodal Large Language Models (MLLMs) demonstrably lack a core component of human intelligence: the ability to `read the room' and assess deception in complex social…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Caixin Kang , Yifei Huang , Liangyang Ouyang , Mingfang Zhang , Ruicong Liu , Yoichi Sato