English
Related papers

Related papers: MVP: Multiple View Prediction Improves GUI Groundi…

200 papers

Prompt Tuning, conditioning on task-specific learned prompt vectors, has emerged as a data-efficient and parameter-efficient method for adapting large pretrained vision-language models to multiple downstream tasks. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Sheng Shen , Shijia Yang , Tianjun Zhang , Bohan Zhai , Joseph E. Gonzalez , Kurt Keutzer , Trevor Darrell

Vision-language models offer strong few-shot capability through prompt tuning but remain vulnerable to noisy labels, which can corrupt prompts and degrade cross-modal alignment. Existing approaches struggle because they often lack the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Lu Niu , Cheng Xue

Multi-view Detection (MVD) is highly effective for occlusion reasoning in a crowded environment. While recent works using deep learning have made significant advances in the field, they have overlooked the generalization aspect, which makes…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Jeet Vora , Swetanjal Dutta , Kanishk Jain , Shyamgopal Karthik , Vineet Gandhi

GUI grounding is a critical capability for enabling GUI agents to execute tasks such as clicking and dragging. However, in complex scenarios like the ScreenSpot-Pro benchmark, existing models often suffer from suboptimal performance.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Borui Zhang , Bo Zhang , Bo Wang , Wenzhao Zheng , Yuhao Cheng , Liang Tang , Yiqiang Yan , Jie Zhou , Jiwen Lu

Multimodal Large Language Models (MLLMs) have increasingly localized and interleaved visual evidence for deliberative reasoning. Grounding-based approaches typically focus on regions of interest (RoIs) by injecting cropped image patches or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Guannan Lv , Ren Nie , Hongjian Dou , Tingting Gao

Multimodal Machine Translation (MMT) focuses on enhancing text-only translation with visual features, which has attracted considerable attention from both natural language processing and computer vision communities. Recent advances still…

Computation and Language · Computer Science 2022-11-29 Hongcheng Guo , Jiaheng Liu , Haoyang Huang , Jian Yang , Zhoujun Li , Dongdong Zhang , Zheng Cui , Furu Wei

While mainstream vision-language models (VLMs) have advanced rapidly in understanding image level information, they still lack the ability to focus on specific areas designated by humans. Rather, they typically rely on large volumes of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Kangyu Zhu , Ziyuan Qin , Huahui Yi , Zekun Jiang , Qicheng Lao , Shaoting Zhang , Kang Li

Visual grounding aims to predict the locations of target objects specified by textual descriptions. For this task with linguistic and visual modalities, there is a latest research line that focuses on only selecting the linguistic-relevant…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Jingchao Wang , Wenlong Zhang , Dingjiang Huang , Hong Wang , Yefeng Zheng

Video temporal grounding (VTG) is a critical task in video understanding and a key capability for extending video large language models (Vid-LLMs) to broader applications. However, existing Vid-LLMs rely on uniform frame sampling to extract…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Rong Fan , Kaiyan Xiao , Minghao Zhu , Liuyi Wang , Kai Dai , Zhao Yang

To extend the application of vision-language models (VLMs) from web images to sensor-mediated physical environments, we propose Multi-View Physical-prompt for Test-Time Adaptation (MVP), a forward-only framework that moves test-time…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Boyeong Im , Wooseok Lee , Yoojin Kwon , Hyung-Sin Kim

Visual grounding is a common vision task that involves grounding descriptive sentences to the corresponding regions of an image. Most existing methods use independent image-text encoding and apply complex hand-crafted modules or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Ming Dai , Lingfeng Yang , Yihao Xu , Zhenhua Feng , Wankou Yang

Visual Grounding (VG) aims at localizing target objects from an image based on given expressions and has made significant progress with the development of detection and vision transformer. However, existing VG methods tend to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Menghao Li , Chunlei Wang , Wenquan Feng , Shuchang Lyu , Guangliang Cheng , Xiangtai Li , Binghao Liu , Qi Zhao

Accurate segmentation of lesion regions is crucial for clinical diagnosis and treatment across various diseases. While deep convolutional networks have achieved satisfactory results in medical image segmentation, they face challenges such…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yulin Chen , Guoheng Huang , Kai Huang , Zijin Lin , Guo Zhong , Shenghong Luo , Jie Deng , Jian Zhou

Medical Visual Grounding (MVG) aims to identify diagnostically relevant phrases from free-text radiology reports and localize their corresponding regions in medical images, providing interpretable visual evidence to support clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yifan Gao , Tao Zhou , Yi Zhou , Ke Zou , Yizhe Zhang , Huazhu Fu

In this work, we propose a novel approach to prioritize the depth map computation of multi-view stereo (MVS) to obtain compact 3D point clouds of high quality and completeness at low computational cost. Our prioritization approach operates…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Christian Mostegel , Friedrich Fraundorfer , Horst Bischof

Recent advances in vision-language models (VLMs) and reinforcement learning (RL) have driven progress in GUI automation. However, most existing methods rely on static, one-shot visual inputs and passive perception, lacking the ability to…

Artificial Intelligence · Computer Science 2026-01-16 Chen Chen , Jiawei Shao , Dakuan Lu , Haoyi Hu , Xiangcheng Liu , Hantao Yao , Wu Liu

While Multimodal Large Language Models (MLLMs) excel at general vision-language tasks, precise coordinate prediction remains a significant challenge, particularly as high-resolution inputs cause visual positional encodings (VPEs) to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Xingjian Tao , Yiwei Wang , Yujun Cai , Yihong Luo , Kai Han , Jing Tang

Multi-view generation with camera pose control and prompt-based customization are both essential elements for achieving controllable generative models. However, existing multi-view generation models do not support customization with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Minjung Shin , Hyunin Cho , Sooyeon Go , Jin-Hwa Kim , Youngjung Uh

Vision-Language Pre-training (VLP) models like CLIP have achieved remarkable success in computer vision and particularly demonstrated superior robustness to distribution shifts of 2D images. However, their robustness under 3D viewpoint…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Shouwei Ruan , Yinpeng Dong , Hanqing Liu , Yao Huang , Hang Su , Xingxing Wei

Multi-view clustering (MvC) aims to integrate information from different views to enhance the capability of the model in capturing the underlying data structures. The widely used joint training paradigm in MvC is potentially not fully…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Zhenglai Li , Jun Wang , Chang Tang , Xinzhong Zhu , Wei Zhang , Xinwang Liu