English
Related papers

Related papers: TACIT Benchmark: A Programmatic Visual Reasoning B…

200 papers

Evaluating the performance of visual language models (VLMs) in graphic reasoning tasks has become an important research topic. However, VLMs still show obvious deficiencies in simulating human-level graphic reasoning capabilities,…

Artificial Intelligence · Computer Science 2025-08-04 Jianyi Zhang , Xu Ji , Ziyin Zhou , Yuchen Zhou , Shubo Shi , Haoyu Wu , Zhen Li , Shizhao Liu

We present TACIT (Transformation-Aware Capturing of Implicit Thought), a diffusion-based transformer for interpretable visual reasoning. Unlike language-based reasoning systems, TACIT operates entirely in pixel space using rectified flow,…

Machine Learning · Computer Science 2026-02-10 Daniel Nobrega

Puzzles have long served as compact and revealing probes of human cognition, isolating abstraction, rule discovery, and systematic reasoning with minimal reliance on prior knowledge. Leveraging these properties, visual puzzles have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Maria Lymperaiou , Vasileios Karampinis , Giorgos Filandrianos , Angelos Vlachos , Chrysoula Zerva , Athanasios Voulodimos

Current multimodal benchmarks often conflate reasoning with domain-specific knowledge, making it difficult to isolate and evaluate general reasoning abilities in non-expert settings. To address this, we introduce VisualPuzzles, a benchmark…

Computation and Language · Computer Science 2025-05-01 Yueqi Song , Tianyue Ou , Yibo Kong , Zecheng Li , Graham Neubig , Xiang Yue

The rapid evolution of video generative models has shifted their focus from producing visually plausible outputs to tackling tasks requiring physical plausibility and logical consistency. However, despite recent breakthroughs such as Veo…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Harold Haodong Chen , Disen Lan , Wen-Jie Shu , Qingyang Liu , Zihan Wang , Sirui Chen , Wenkai Cheng , Kanghao Chen , Hongfei Zhang , Zixin Zhang , Rongjin Guo , Yu Cheng , Ying-Cong Chen

The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critical question remains: is such reasoning genuinely grounded in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jusheng Zhang , Kaitong Cai , Xiaoyang Guo , Sidi Liu , Qinhan Lv , Ruiqi Chen , Jing Yang , Yijia Fan , Xiaofei Sun , Jian Wang , Ziliang Chen , Liang Lin , Keze Wang

Beneath the stunning visual fidelity of modern AIGC models lies a "logical desert", where systems fail tasks that require physical, causal, or complex spatial reasoning. Current evaluations largely rely on superficial metrics or fragmented…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Haonan Han , Jiancheng Huang , Xiaopeng Sun , Junyan He , Rui Yang , Jie Hu , Xiaojiang Peng , Lin Ma , Xiaoming Wei , Xiu Li

Existing vision-language understanding benchmarks largely consist of images of objects in their usual contexts. As a consequence, recent multimodal large language models can perform well with only a shallow visual understanding by relying…

Multimodal Large Language Models are primarily trained and evaluated on aligned image-text pairs, which leaves their ability to detect and resolve real-world inconsistencies largely unexplored. In open-domain applications visual and textual…

We propose Perceptual Taxonomy, a structured process of scene understanding that first recognizes objects and their spatial configurations, then infers task-relevant properties such as material, affordance, function, and physical attributes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Jonathan Lee , Xingrui Wang , Jiawei Peng , Luoxin Ye , Zehan Zheng , Tiezheng Zhang , Tao Wang , Wufei Ma , Siyi Chen , Yu-Cheng Chou , Prakhar Kaushik , Alan Yuille

Vision-language tracking has received increasing attention in recent years, as textual information can effectively address the inflexibility and inaccuracy associated with specifying the target object to be tracked. Existing works either…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Xiao Wang , Liye Jin , Xufeng Lou , Shiao Wang , Lan Chen , Bo Jiang , Zhipeng Zhang

Spatial reasoning ability is crucial for Vision Language Models (VLMs) to support real-world applications in diverse domains including robotics, augmented reality, and autonomous navigation. Unfortunately, existing benchmarks are inadequate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Xinmiao Huang , Qisong He , Zhenglin Huang , Boxuan Wang , Zhuoyun Li , Guangliang Cheng , Yi Dong , Xiaowei Huang

We propose MIRA, a new benchmark designed to evaluate models in scenarios where generating intermediate visual images is essential for successful reasoning. Unlike traditional CoT methods that rely solely on text, tasks in MIRA require…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yiyang Zhou , Haoqin Tu , Zijun Wang , Zeyu Wang , Niklas Muennighoff , Fan Nie , Yejin Choi , James Zou , Chaorui Deng , Shen Yan , Haoqi Fan , Cihang Xie , Huaxiu Yao , Qinghao Ye

Computer vision models excel at making predictions when the test distribution closely resembles the training distribution. Such models have yet to match the ability of biological vision to learn from multiple sources and generalize to new…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Tanmay Gupta , Ryan Marten , Aniruddha Kembhavi , Derek Hoiem

Current multimodal latent reasoning often relies on external supervision (e.g., auxiliary images), ignoring intrinsic visual attention dynamics. In this work, we identify a critical Perception Gap in distillation: student models frequently…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Linquan Wu , Tianxiang Jiang , Yifei Dong , Haoyu Yang , Fengji Zhang , Shichaang Meng , Ai Xuan , Linqi Song , Jacky Keung

Spatial reasoning is a core aspect of human intelligence that allows perception, inference and planning in 3D environments. However, current vision-language models (VLMs) struggle to maintain geometric coherence and cross-view consistency…

Artificial Intelligence · Computer Science 2025-12-03 Qiyao Xue , Weichen Liu , Shiqi Wang , Haoming Wang , Yuyang Wu , Wei Gao

Reasoning benchmarks such as the Abstraction and Reasoning Corpus (ARC) and ARC-AGI are widely used to assess progress in artificial intelligence and are often interpreted as probes of core, so-called ``fluid'' reasoning abilities. Despite…

Computation and Language · Computer Science 2026-01-12 Xinhe Wang , Jin Huang , Xingjian Zhang , Tianhao Wang , Jiaqi W. Ma

Learning commonsense reasoning from visual contexts and scenes in real-world is a crucial step toward advanced artificial intelligence. However, existing video reasoning benchmarks are still inadequate since they were mainly designed for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Andong Wang , Bo Wu , Sunli Chen , Zhenfang Chen , Haotian Guan , Wei-Ning Lee , Li Erran Li , Chuang Gan

Generative large language models as tools in the legal domain have the potential to improve the justice system. However, the reasoning behavior of current generative models is brittle and poorly understood, hence cannot be responsibly…

Artificial Intelligence · Computer Science 2025-05-06 Cor Steging , Silja Renooij , Bart Verheij

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu