English
Related papers

Related papers: SPHINX: A Synthetic Environment for Visual Percept…

200 papers

Despite rapid progress, multimodal reasoning still lacks a systematic approach to synthesize large-scale vision-centric datasets beyond visual math. We introduce a framework able to synthesize vision-centric problems spanning diverse levels…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 David Acuna , Chao-Han Huck Yang , Yuntian Deng , Jaehun Jung , Ximing Lu , Prithviraj Ammanabrolu , Hyunwoo Kim , Yuan-Hong Liao , Yejin Choi

We present SpinBench, a cognitively grounded diagnostic benchmark for evaluating spatial reasoning in vision language models (VLMs). SpinBench is designed around the core challenge of spatial reasoning: perspective taking, the ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yuyou Zhang , Radu Corcodel , Chiori Hori , Anoop Cherian , Ding Zhao

Although most current large multimodal models (LMMs) can already understand photos of natural scenes and portraits, their understanding of abstract images, e.g., charts, maps, or layouts, and visual reasoning capabilities remains quite…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Wenqi Zhang , Zhenglin Cheng , Yuanyu He , Mengna Wang , Yongliang Shen , Zeqi Tan , Guiyang Hou , Mingqian He , Yanna Ma , Weiming Lu , Yueting Zhuang

Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yuhong Liu , Beichen Zhang , Yuhang Zang , Yuhang Cao , Long Xing , Xiaoyi Dong , Haodong Duan , Dahua Lin , Jiaqi Wang

Recent progress in Vision Language Models (VLMs) has raised the question of whether they can reliably perform nonverbal reasoning. To this end, we introduce VRIQ (Visual Reasoning IQ), a novel benchmark designed to assess and analyze the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Tina Khezresmaeilzadeh , Jike Zhong , Konstantinos Psounis

While many vision-language models (VLMs) are developed to answer well-defined, straightforward questions with highly specified targets, as in most benchmarks, they often struggle in practice with complex open-ended tasks, which usually…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Chenrui Fan , Yijun Liang , Shweta Bhardwaj , Kwesi Cobbina , Ming Li , Tianyi Zhou

Multimodal Small-to-Medium sized Language Models (MSLMs) have demonstrated strong capabilities in integrating visual and textual information but still face significant limitations in visual comprehension and mathematical reasoning,…

Machine Learning · Computer Science 2026-01-27 Ashutosh Bajpai , Akshat Bhandari , Akshay Nambi , Tanmoy Chakraborty

Effectiveness and interpretability are two essential properties for trustworthy AI systems. Most recent studies in visual reasoning are dedicated to improving the accuracy of predicted answers, and less attention is paid to explaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Shi Chen , Qi Zhao

Spatial reasoning is a core component of human cognition, enabling individuals to perceive, comprehend, and interact with the physical world. It relies on a nuanced understanding of spatial structures and inter-object relationships, serving…

Artificial Intelligence · Computer Science 2025-08-27 Zesen Lyu , Dandan Zhang , Wei Ye , Fangdi Li , Zhihang Jiang , Yao Yang

Spatial reasoning remains a fundamental challenge for Vision-Language Models (VLMs), with current approaches struggling to achieve robust performance despite recent advances. We identify that this limitation stems from a critical gap:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Hongxing Li , Dingming Li , Zixuan Wang , Yuchen Yan , Hang Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu , Jun Xiao , Yueting Zhuang

Geospatial reasoning requires solving image-grounded problems over the complex spatial structure of a scene. However, developing this capability is hindered by the cost of annotating a vast and combinatorial question space. We propose GeoX,…

Artificial Intelligence · Computer Science 2026-05-20 Kyeongjin Ahn , Seungeon Lee , Krishna P. Gummadi , Meeyoung Cha

Reinforcement learning with verifiable rewards (RLVR) is a promising approach for improving the complex reasoning abilities of large language models (LLMs). However, current RLVR methods face two significant challenges: the near-miss reward…

Artificial Intelligence · Computer Science 2025-07-04 Kaiyi Zhang , Ang Lv , Jinpeng Li , Yongbo Wang , Feng Wang , Haoyuan Hu , Rui Yan

Humans can imagine and manipulate visual images mentally, a capability known as spatial visualization. While many multi-modal benchmarks assess reasoning on visible visual information, the ability to infer unseen relationships through…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siting Wang , Minnan Pei , Luoyang Sun , Cheng Deng , Yuchen Li , Kun Shao , Zheng Tian , Haifeng Zhang , Jun Wang

Vision language models (VLMs) perform well on many tasks but often fail at spatial reasoning, which is essential for navigation and interaction with physical environments. Many spatial reasoning tasks depend on fundamental two-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Yihong Tang , Ao Qu , Zhaokai Wang , Dingyi Zhuang , Zhaofeng Wu , Wei Ma , Shenhao Wang , Yunhan Zheng , Zhan Zhao , Jinhua Zhao

Visual arguments, often used in advertising or social causes, rely on images to persuade viewers to do or believe something. Understanding these arguments requires selective vision: only specific visual stimuli within an image are relevant…

Computation and Language · Computer Science 2024-10-24 Jiwan Chung , Sungjae Lee , Minseo Kim , Seungju Han , Ashkan Yousefpour , Jack Hessel , Youngjae Yu

While imitation learning (IL) offers a promising framework for teaching robots various behaviors, learning complex tasks remains challenging. Existing IL policies struggle to generalize effectively across visual and spatial variations even…

Robotics · Computer Science 2024-12-10 Priya Sundaresan , Hengyuan Hu , Quan Vuong , Jeannette Bohg , Dorsa Sadigh

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

While multi-modal large language models (MLLMs) have shown significant progress on many popular visual reasoning benchmarks, whether they possess abstract visual reasoning abilities remains an open question. Similar to the Sudoku puzzles,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yifan Jiang , Jiarui Zhang , Kexuan Sun , Zhivar Sourati , Kian Ahrabian , Kaixin Ma , Filip Ilievski , Jay Pujara

Multimodal latent-space reasoning aims to replace explicit thinking with images by performing visual reasoning directly in a compact latent space. However, existing approaches largely rely on visual supervision and produce latent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Tianrun Xu , Yue Sun , Qixun Wang , Jingyi Lu , Yuan Wang , Tianren Zhang , Longteng Guo , Fengyun Rao , Jing Lyu , Feng Chen , Jing Liu

Vision-Language Models (VLMs) excel at understanding single images, aided by high-quality instruction datasets. However, multi-image reasoning remains underexplored in the open-source community due to two key challenges: (1) scaling…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Andrew Li , Rahul Thapa , Rahul Chalamala , Qingyang Wu , Kezhen Chen , James Zou