English
Related papers

Related papers: PRISM-Bench: A Benchmark of Puzzle-Based Visual Ta…

200 papers

This study investigates whether diagnostic prompting can improve Multimodal Large Language Model (MLLM) reliability for visual complexity assessment of Amazon Search Results Pages (SRP). We compare diagnostic prompting with standard gestalt…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Divendar Murtadak , Yoon Kim , Trilokya Akula

Cognitive textual and visual reasoning tasks, including puzzles, series, and analogies, demand the ability to quickly reason, decipher, and evaluate patterns both textually and spatially. Due to extensive training on vast amounts of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Pranshu Pandya , Vatsal Gupta , Agney S Talwarr , Tushar Kataria , Dan Roth , Vivek Gupta

Vision Language Models (VLMs) demonstrate remarkable proficiency in addressing a wide array of visual questions, which requires strong perception and reasoning faculties. Assessing these two competencies independently is crucial for model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Yuxuan Qiao , Haodong Duan , Xinyu Fang , Junming Yang , Lin Chen , Songyang Zhang , Jiaqi Wang , Dahua Lin , Kai Chen

While visual question-answering (VQA) benchmarks have catalyzed the development of reasoning techniques, they have focused on vertical thinking. Effective problem-solving also necessitates lateral thinking, which remains understudied in AI…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Koen Kraaijveld , Yifan Jiang , Kaixin Ma , Filip Ilievski

Scaling LLM-based embodied agents from text-only environments to complex multimodal settings remains a major challenge. Recent work identifies a perception-reasoning-decision gap in standalone Vision-Language Models (VLMs), which often…

Artificial Intelligence · Computer Science 2026-05-08 Mohamed Salim Aissi , Clemence Grislain , Clement Romac , Laure Soulier , Mohamed Chetouani , Olivier Sigaud , Nicolas Thome

Recent advances in Vision-Language Models (VLMs) have achieved impressive progress in multimodal mathematical reasoning. Yet, how much visual information truly contributes to reasoning remains unclear. Existing benchmarks report strong…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yuandong Wang , Yao Cui , Yuxin Zhao , Zhen Yang , Yangfu Zhu , Zhenzhou Shao

Recent advances in Large Language Models (LLMs) have shown promising results in complex reasoning tasks. However, current evaluations predominantly focus on single-turn reasoning scenarios, leaving interactive tasks largely unexplored. We…

Computation and Language · Computer Science 2026-05-22 Xiaoyuan Li , Keqin Bao , Yubo Ma , Moxin Li , Wenjie Wang , Rui Men , Yichang Zhang , Fuli Feng , Dayiheng Liu

Solving expert-level multimodal tasks is a key milestone towards general intelligence. As the capabilities of multimodal large language models (MLLMs) continue to improve, evaluation of such advanced multimodal intelligence becomes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yan Yang , Dongxu Li , Haoning Wu , Bei Chen , Liu Liu , Liyuan Pan , Junnan Li

Vision-language models (VLMs) exhibit strong zero-shot generalization on natural images and show early promise in interpretable medical image analysis. However, existing benchmarks do not systematically evaluate whether these models truly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Tianhong Zhou , Yin Xu , Yingtao Zhu , Chuxi Xiao , Haiyang Bian , Lei Wei , Xuegong Zhang

Vision-Language Models (VLMs) have achieved remarkable progress across tasks such as visual question answering and image captioning. Yet, the extent to which these models perform visual reasoning as opposed to relying on linguistic priors…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Brigitta Malagurski Törtei , Yasser Dahou , Ngoc Dung Huynh , Wamiq Reyaz Para , Phúc H. Lê Khac , Ankit Singh , Sofian Chaybouti , Sanath Narayan

Programmatic video generation through code offers geometric precision and temporal coherence beyond pixel-level diffusion models, yet rigorously evaluating whether language models can produce spatially correct animated outputs remains an…

Artificial Intelligence · Computer Science 2026-05-20 Qiran Zhang , Yuheng Wang , Runde Yang , Lin Wu , Jingru Fan , Shu Yao , Jie Zhang , Tianle Zhou , Huatao Li , Ruijie Shi , Yihan Li , Chen Qian

Multimodal Large Language Models (MLLMs) excel in solving text-based mathematical problems, but they struggle with mathematical diagrams since they are primarily trained on natural scene images. For humans, visual aids generally enhance…

Computation and Language · Computer Science 2024-09-26 Wenwen Zhuang , Xin Huang , Xiantao Zhang , Jin Zeng

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

Machine Learning · Computer Science 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Understanding perspective is fundamental to human visual perception, yet the extent to which multimodal large language models (MLLMs) internalize perspective geometry remains unclear. We introduce MMPerspective, the first benchmark…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yolo Y. Tang , Pinxin Liu , Zhangyun Tan , Mingqian Feng , Rui Mao , Chao Huang , Jing Bi , Yunzhong Xiao , Susan Liang , Hang Hua , Ali Vosoughi , Luchuan Song , Zeliang Zhang , Chenliang Xu

While large multimodal models (LMMs) have demonstrated strong performance across various Visual Question Answering (VQA) tasks, certain challenges require complex multi-step reasoning to reach accurate answers. One particularly challenging…

The ability to understand and reason about spatial relationships between objects in images is an important component of visual reasoning. This skill rests on the ability to recognize and localize objects of interest and determine their…

Computation and Language · Computer Science 2024-10-14 Navid Rajabi , Jana Kosecka

Algorithmic reasoning is a fundamental cognitive ability that plays a pivotal role in problem-solving and decision-making processes. Reinforcement Learning (RL) has demonstrated remarkable proficiency in tasks such as motor control,…

Machine Learning · Computer Science 2024-07-02 Benjamin Estermann , Luca A. Lanzendörfer , Yannick Niedermayr , Roger Wattenhofer

Recent advances in large Vision-Language Models (VLMs) have exhibited strong reasoning capabilities on complex visual tasks by thinking with images in their Chain-of-Thought (CoT), which is achieved by actively invoking tools to analyze…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Wenhao Yang , Yu Xia , Jinlong Huang , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Yuanyu Wan , Lijun Zhang

Solving topological grid puzzles requires reasoning over global spatial invariants such as connectivity, loop closure, and region symmetry and remains challenging for even the most powerful large language models (LLMs). To study these…

Artificial Intelligence · Computer Science 2026-03-13 Mayug Maniparambil , Nils Hoehing , Janak Kapuriya , Arjun Karuvally , Ellen Rushe , Anthony Ventresque , Noel O'Connor , Fergal Reid