English

VIG-RL: Learning to Search and Insert for Verified Image Grounding

Information Retrieval 2026-07-30 v1

Abstract

In knowledge-intensive scenarios, providing reliable interleaved text-image responses requires Verified Image Grounding (VIG): the precise integration of retrieved authentic visual evidence. Existing retrieval-augmented frameworks predominantly rely on decoupled, static pipelines, inherently failing to dynamically reason about when external knowledge is required and where visual assets should be contextually inserted. To bridge this gap, we propose VIG-RL, an autonomous agentic framework that formulates the search-selection-insertion workflow as an active decision-making process. Operating within a dynamic ReAct-style loop, VIG-RL is optimized via reinforcement learning, guided by a composite reward system that holistically evaluates the agent's step-by-step tool execution and final multimodal alignment. Extensive evaluations demonstrate that VIG-RL establishes a new state-of-the-art, significantly outperforming existing static baselines.

Cite

@article{arxiv.2607.28055,
  title  = {VIG-RL: Learning to Search and Insert for Verified Image Grounding},
  author = {Qinhan Yu and Jun Guang and Chong Chen and Wentao Zhang},
  journal= {arXiv preprint arXiv:2607.28055},
  year   = {2026}
}