PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking
Abstract
This paper explores multi-turn visual reasoning and observes that MLLMs repeatedly fail to localize the target, leading to long, redundant trajectories. We attribute this failure to the entanglement of reasoning and perception within a single model, the MLLM reasons and localizes simultaneously, and inaccurate localization triggers additional reasoning turns that bloat the trajectory. To solve this problem, we propose PixelEyes, a multi-turn visual reasoning agent that explicitly decouples reasoning from perception, i.e., the reasoner decides what to look for, while a specialized perception tool answers where it is. Specifically, PixelEyes introduces 1) Mask-guided Visual Search. A referring segmentation model is invoked to provide mask-precise localization, freeing the reasoner from the need to compensate for imprecise grounding. 2) Semantic-region Breadth-first Search (BFS). To eliminate redundant loops caused by repeatedly cropping incorrect sub-regions, we organize exploration as a breadth-first search over semantic regions. To internalize these capabilities, we construct the PixelEyes-6K dataset by resynthesizing expert trajectories from existing data. This explicitly embeds our mask-guided search and BFS logic into the model. We further introduce Pinpoint-Bench, a zero-hint visual search benchmark, i.e., no location cues are provided in the question, with instance-level masks and bounding boxes that separate localization failures from reasoning failures, enabling fine-grained analysis of failure modes such as inattentional blindness. Recent state-of-the-art MLLMs and visual reasoning agents leave large headroom on Pinpoint-Bench, demonstrating its quality and difficulty. Code and models are open-sourced.
Cite
@article{arxiv.2607.00115,
title = {PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking},
author = {Dengxian Gong and Yuanzheng Wu and Haobo Yuan and Zhengdong Hu and Tao Zhang and Yikang Zhou and Shihao Chen and Quanzhu Niu and Kai Wang and Jason Li and Haochen Wang and Lu Qi and Shunping Ji and Ming-Hsuan Yang},
journal= {arXiv preprint arXiv:2607.00115},
year = {2026}
}
Comments
22pages, 10 figures