English

GEAR-Seg: A Grounded Explainable Agent for Reasoning Segmentation and Data Engine

Computer Vision and Pattern Recognition 2026-07-01 v1

Abstract

Reasoning segmentation requires localizing targets based on complex, implicit queries. Current end-to-end models typically entangle perception and deduction into an opaque black box, severely limiting interpretability and scalability. To address this, we propose GEAR-Seg (Grounded Explainable Agent for Reasoning Segmentation), an explicitly decoupled agent that shifts the paradigm by translating visual pixels into dense, attribute-rich text. By decoupling class-agnostic segmentation, semantic description, and Large Language Model (LLM) deduction, GEAR-Seg transforms implicit reasoning into an explicit, trackable logic chain. As a zero-shot inference framework, it achieves highly competitive performance across diverse reasoning and fine-grained referring segmentation benchmarks. Furthermore, GEAR-Seg inherently functions as a highly scalable data engine. Utilizing this engine, we construct GEAR-131K, a massive benchmark (over 38k images, 656k QA-mask pairs) introducing a multifaceted taxonomy tailored for complex real-world manipulation-oriented reasoning. Finally, distillation experiments demonstrate that lightweight models supervised exclusively by our automated pipeline closely match the upper-bound performance of costly human-annotated baselines.

Cite

@article{arxiv.2607.00544,
  title  = {GEAR-Seg: A Grounded Explainable Agent for Reasoning Segmentation and Data Engine},
  author = {Yanan Wang and Wen Li and Yibin Ying and Zhenghao Fei},
  journal= {arXiv preprint arXiv:2607.00544},
  year   = {2026}
}

Comments

21 pages, 8 figures