English
Related papers

Related papers: AgroVG: A Large-Scale Multi-Source Benchmark for A…

200 papers

Medical Visual Grounding (MVG) aims to identify diagnostically relevant phrases from free-text radiology reports and localize their corresponding regions in medical images, providing interpretable visual evidence to support clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yifan Gao , Tao Zhou , Yi Zhou , Ke Zou , Yizhe Zhang , Huazhu Fu

Unlike Object Detection, Visual Grounding task necessitates the detection of an object described by complex free-form language. To simultaneously model such complex semantic and visual representations, recent state-of-the-art studies adopt…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Weitai Kang , Luowei Zhou , Junyi Wu , Changchang Sun , Yan Yan

Agricultural robots are serving as powerful assistants across a wide range of agricultural tasks, nevertheless, still heavily relying on manual operations or railway systems for movement. The AgriVLN method and the A2A benchmark…

Robotics · Computer Science 2026-01-05 Xiaobei Zhao , Xingqi Lyu , Xin Chen , Xiang Li

Visual grounding aims to identify objects or regions in a scene based on natural language descriptions, essential for spatially aware perception in autonomous driving. However, existing visual grounding tasks typically depend on bounding…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Zhan Shi , Song Wang , Junbo Chen , Jianke Zhu

Vision-Language Models (VLMs) have demonstrated effective perception and reasoning capabilities on general-domain tasks, leading to growing interest in their application to Earth observation. However, a systematic benchmark for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Ronghao Fu , Haoran Liu , Weijie Zhang , Zhiwen Lin , Xiao Yang , Peng Zhang , Bo Yang

Large-scale text-to-image diffusion models have shown impressive capabilities for generative tasks by leveraging strong vision-language alignment from pre-training. However, most vision-language discriminative tasks require extensive…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Xuyang Liu , Siteng Huang , Yachen Kang , Honggang Chen , Donglin Wang

A core capability towards general embodied intelligence lies in localizing task-relevant objects from an egocentric perspective, formulated as Spatio-Temporal Video Grounding (STVG). Despite recent progress, existing STVG studies remain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Qi'ao Xu , Tianwen Qian , Yuqian Fu , Kailing Li , Yang Jiao , Jiacheng Zhang , Xiaoling Wang , Liang He

Visual grounding is a promising path toward more robust and accurate Natural Language Processing (NLP) models. Many multimodal extensions of BERT (e.g., VideoBERT, LXMERT, VL-BERT) allow a joint modeling of texts and images that lead to…

Computation and Language · Computer Science 2021-03-26 Damien Sileo

3D Visual Grounding (3DVG) aims at localizing 3D object based on textual descriptions. Conventional supervised methods for 3DVG often necessitate extensive annotations and a predefined vocabulary, which can be restrictive. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhihao Yuan , Jinke Ren , Chun-Mei Feng , Hengshuang Zhao , Shuguang Cui , Zhen Li

Visual grounding is a long-lasting problem in vision-language understanding due to its diversity and complexity. Current practices concentrate mostly on performing visual grounding in still images or well-trimmed video clips. This work, on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Qianyu Feng , Yunchao Wei , Mingming Cheng , Yi Yang

Grounding natural language in images, such as localizing "the black dog on the left of the tree", is one of the core problems in artificial intelligence, as it needs to comprehend the fine-grained and compositional language space. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Richang Hong , Daqing Liu , Xiaoyu Mo , Xiangnan He , Hanwang Zhang

Manual labeling of animal images remains a significant bottleneck in ecological research, limiting the scale and efficiency of biodiversity monitoring efforts. This study investigates whether state-of-the-art Vision Transformer (ViT)…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Hugo Markoff , Stefan Hein Bengtson , Michael Ørsted

While multimodal large language models (MLLMs) have demonstrated extraordinary vision-language understanding capabilities, their abilities to solve instance-level visual-language problems beyond a single image warrant further exploration.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Yunqiu Xu , Linchao Zhu , Yi Yang

Vision-Language Models (VLMs) can generate convincing clinical narratives, yet frequently struggle to visually ground their statements. We posit this limitation arises from the scarcity of high-quality, large-scale clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Mengmeng Zhang , Xiaoping Wu , Hao Luo , Fan Wang , Yisheng Lv

Plant disease diagnosis is critical for food security, yet training disease-recognition models that generalize across crops, pathogens, and field conditions remains challenging because labeled disease images are far less abundant and…

This work presents a simple yet effective workflow for automatically scaling instruction-following data to elicit pixel-level grounding capabilities of VLMs under complex instructions. In particular, we address five critical real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yongshuo Zong , Qin Zhang , Dongsheng An , Zhihua Li , Xiang Xu , Linghan Xu , Zhuowen Tu , Yifan Xing , Onkar Dabeer

Visual Grounding (VG) in Visual Question Answering (VQA) systems describes how well a system manages to tie a question and its answer to relevant image regions. Systems with strong VG are considered intuitively interpretable and suggest an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Daniel Reich , Felix Putze , Tanja Schultz

GUI grounding is a critical component in building capable GUI agents. However, existing grounding benchmarks suffer from significant limitations: they either provide insufficient data volume and narrow domain coverage, or focus excessively…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Beitong Zhou , Zhexiao Huang , Yuan Guo , Zhangxuan Gu , Tianyu Xia , Zichen Luo , Fei Tang , Dehan Kong , Yanyi Shang , Suling Ou , Zhenlin Guo , Changhua Meng , Shuheng Shen

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

The 3D weakly-supervised visual grounding task aims to localize oriented 3D boxes in point clouds based on natural language descriptions without requiring annotations to guide model learning. This setting presents two primary challenges:…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Xiaoqi Li , Jiaming Liu , Nuowei Han , Liang Heng , Yandong Guo , Hao Dong , Yang Liu