English

Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs

Computer Vision and Pattern Recognition 2026-03-19 v1 Artificial Intelligence

Abstract

Vision-language models (VLMs) typically process images at a native high-resolution, forcing a trade-off between accuracy and computational efficiency: high-resolution inputs capture fine details but incur significant computational costs, while low-resolution inputs advocate for efficiency, they potentially miss critical visual information, like small text. We present AwaRes, a spatial-on-demand framework that resolves this accuracy-efficiency trade-off by operating on a low-resolution global view and using tool-calling to retrieve only high-resolution segments needed for a given query. We construct supervised data automatically: a judge compares low- vs.\ high-resolution answers to label whether cropping is needed, and an oracle grounding model localizes the evidence for the correct answer, which we map to a discrete crop set to form multi-turn tool-use trajectories. We train our framework with cold-start SFT followed by multi-turn GRPO with a composite reward that combines semantic answer correctness with explicit crop-cost penalties. Project page: https://nimrodshabtay.github.io/AwaRes

Keywords

Cite

@article{arxiv.2603.16932,
  title  = {Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs},
  author = {Nimrod Shabtay and Moshe Kimhi and Artem Spector and Sivan Haray and Ehud Rivlin and Chaim Baskin and Raja Giryes and Eli Schwartz},
  journal= {arXiv preprint arXiv:2603.16932},
  year   = {2026}
}
R2 v1 2026-07-01T11:24:49.227Z