English
Related papers

Related papers: MVP: Multiple View Prediction Improves GUI Groundi…

200 papers

In recent years, we have witnessed a surge of interest in multi-view representation learning, which is concerned with the problem of learning representations of multi-view data. When facing multiple views that are highly related but sightly…

Machine Learning · Computer Science 2020-06-20 Xiangzhu Meng , Lin Feng , Huibing Wang

Visual grounding is a task that aims to locate a target object according to a natural language expression. As a multi-modal task, feature interaction between textual and visual inputs is vital. However, previous solutions mainly handle each…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Chonghan Chen , Qi Jiang , Chih-Hao Wang , Noel Chen , Haohan Wang , Xiang Li , Bhiksha Raj

Pre-trained vision-language models (VLMs) have shown remarkable generalization capabilities via prompting, which leverages VLMs as knowledge bases to extract information beneficial for downstream tasks. However, existing methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xiaoyu Qiu , Hao Feng , Yuechen Wang , Wengang Zhou , Houqiang Li

Recent text-to-image models, such as Stable Diffusion, have achieved impressive visual quality, yet they often suffer from geometric inconsistencies that undermine the structural realism of generated scenes. One prominent issue is vanishing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Ryota Okumura , Kaede Shiohara , Toshihiko Yamasaki

We present GLIPv2, a grounded VL understanding model, that serves both localization tasks (e.g., object detection, instance segmentation) and Vision-Language (VL) understanding tasks (e.g., VQA, image captioning). GLIPv2 elegantly unifies…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Haotian Zhang , Pengchuan Zhang , Xiaowei Hu , Yen-Chun Chen , Liunian Harold Li , Xiyang Dai , Lijuan Wang , Lu Yuan , Jenq-Neng Hwang , Jianfeng Gao

The classification performance of the random vector functional link (RVFL), a randomized neural network, has been widely acknowledged. However, due to its shallow learning nature, RVFL often fails to consider all the relevant information…

Machine Learning · Computer Science 2025-02-11 M. Tanveer , R. K. Sharma , M. Sajid , A. Quadir

We open-source MiMo-VL-7B-SFT and MiMo-VL-7B-RL, two powerful vision-language models delivering state-of-the-art performance in both general visual understanding and multimodal reasoning. MiMo-VL-7B-RL outperforms Qwen2.5-VL-7B on 35 out of…

Machine Interpreting systems are currently implemented as unimodal, real-time speech-to-speech architectures, processing translation exclusively on the basis of the linguistic signal. Such reliance on a single modality, however, constrains…

Computation and Language · Computer Science 2025-09-30 Claudio Fantinuoli

In the rapidly evolving field of 3D reconstruction, 3D Gaussian Splatting (3DGS) and 2D Gaussian Splatting (2DGS) represent significant advancements. Although 2DGS compresses 3D Gaussian primitives into 2D Gaussian surfels to effectively…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Zhuoxiao Li , Shanliang Yao , Yijie Chu , Angel F. Garcia-Fernandez , Yong Yue , Eng Gee Lim , Xiaohui Zhu

Recent years have witnessed remarkable progress in 3D content generation. However, corresponding evaluation methods struggle to keep pace. Automatic approaches have proven challenging to align with human preferences, and the mixed…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Weitao Wang , Haoran Xu , Yuxiao Yang , Zhifang Liu , Jun Meng , Haoqian Wang

Despite video forecasting has been a widely explored topic in recent years, the mainstream of the existing work still limits their models with a single prediction space but completely neglects the way to leverage their model with…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Mengcheng Lan , Shuliang Ning , Yanran Li , Qian Chen , Xunlai Chen , Xiaoguang Han , Shuguang Cui

Reference-guided video editing takes a source video, a text instruction, and a reference image as inputs, requiring the model to faithfully apply the instructed edits while preserving original motion and unedited content. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Tong Wang , Meng Zou , Chengjing Wu , Xiaochao Qu , Luoqi Liu , Xiaolin Hu , Ting Liu

Multiview learning (MVL) seeks to leverage the benefits of diverse perspectives to complement each other, effectively extracting and utilizing the latent information within the dataset. Several twin support vector machine-based MVL (MvTSVM)…

Machine Learning · Computer Science 2024-08-13 A. Quadir , M. Tanveer

Multi-view 3D visual grounding is critical for autonomous driving vehicles to interpret natural languages and localize target objects in complex environments. However, existing datasets and methods suffer from coarse-grained language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Fuhao Li , Huan Jin , Bin Gao , Liaoyuan Fan , Lihui Jiang , Long Zeng

Feature representation learning is the key recipe for learning-based Multi-View Stereo (MVS). As the common feature extractor of learning-based MVS, vanilla Feature Pyramid Networks (FPNs) suffer from discouraged feature representations for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Chenjie Cao , Xinlin Ren , Yanwei Fu

We revisit and advance visual prompting (VP), an input prompting technique for vision tasks. VP can reprogram a fixed, pre-trained source model to accomplish downstream tasks in the target domain by simply incorporating universal prompts…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Aochuan Chen , Yuguang Yao , Pin-Yu Chen , Yihua Zhang , Sijia Liu

Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved performance on tasks such as visual grounding and visual question answering. However, the reasoning processes of these models remain largely opaque;…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Haobo Yuan , Yueyi Sun , Yanwei Li , Tao Zhang , Xueqing Deng , Henghui Ding , Lu Qi , Anran Wang , Xiangtai Li , Ming-Hsuan Yang

We consider the generic problem of detecting low-level structures in images, which includes segmenting the manipulated parts, identifying out-of-focus pixels, separating shadow regions, and detecting concealed objects. Whereas each such…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Weihuang Liu , Xi Shen , Chi-Man Pun , Xiaodong Cun

The progression of deep learning and the widespread adoption of sensors have facilitated automatic multi-view fusion (MVF) about the cardiovascular system (CVS) signals. However, prevalent MVF model architecture often amalgamates CVS…

Machine Learning · Computer Science 2024-06-14 Qihan Hu , Daomiao Wang , Hong Wu , Jian Liu , Cuiwei Yang

State-of-the-art large multi-modal models (LMMs) face challenges when processing high-resolution images, as these inputs are converted into enormous visual tokens, many of which are irrelevant to the downstream task. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xinyu Huang , Yuhao Dong , Weiwei Tian , Bo Li , Rui Feng , Ziwei Liu