English
Related papers

Related papers: Gradient-Attention Guided Dual-Masking Synergetic …

200 papers

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

Human-centric visual analysis plays a pivotal role in diverse applications, including surveillance, healthcare, and human-computer interaction. With the emergence of large-scale unlabeled human image datasets, there is an increasing need…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mingshuang Luo , Ruibing Hou , Bo Chao , Hong Chang , Zimo Liu , Yaowei Wang , Shiguang Shan

We introduce Gaussian masking for Language-Image Pre-Training (GLIP) a novel, straightforward, and effective technique for masking image patches during pre-training of a vision-language model. GLIP builds on Fast Language-Image Pre-Training…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Mingliang Liang , Martha Larson

Contrastive Language-Image Pre-training (CLIP) has drawn increasing attention recently for its transferable visual representation learning. However, due to the semantic gap within datasets, CLIP's pre-trained image-text alignment becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Longtian Qiu , Renrui Zhang , Ziyu Guo , Ziyao Zeng , Zilu Guo , Yafeng Li , Guangnan Zhang

Contrastive learning has emerged as an efficient framework to learn multimodal representations. CLIP, a seminal work in this area, achieved impressive results by training on paired image-text data using the contrastive loss. Recent work…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Enrico Fini , Pietro Astolfi , Adriana Romero-Soriano , Jakob Verbeek , Michal Drozdzal

Contrastive Language Image Pre-training (CLIP) has recently demonstrated success across various tasks due to superior feature representation empowered by image-text contrastive learning. However, the instance discrimination method used by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xiang An , Kaicheng Yang , Xiangzi Dai , Ziyong Feng , Jiankang Deng

Vision-language models such as CLIP have shown impressive capabilities in aligning images and text, but they often struggle with lengthy and detailed text descriptions due to pre-training on short and concise captions. We present FAST-GOAL…

Artificial Intelligence · Computer Science 2026-05-27 Hyungyu Choi , Young Kyun Jang , Chanho Eom

Visual gaze estimation, with its wide-ranging application scenarios, has garnered increasing attention within the research community. Although existing approaches infer gaze solely from image signals, recent advances in visual-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jun Wang , Hao Ruan , Liangjian Wen , Yong Dai , Mingjie Wang

Contrastive Language-Image Pre-Training (CLIP) is a popular method for learning multimodal latent spaces with well-organized semantics. Despite its wide range of applications, CLIP's latent space is known to fail at handling complex…

Machine Learning · Computer Science 2026-03-17 Raphi Kang , Yue Song , Georgia Gkioxari , Pietro Perona

Recent advances in 3D reconstruction techniques and vision-language models have fueled significant progress in 3D semantic understanding, a capability critical to robotics, autonomous driving, and virtual/augmented reality. However, methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Lei Tian , Xiaomin Li , Liqian Ma , Hao Yin , Zirui Zheng , Hefei Huang , Taiqing Li , Huchuan Lu , Xu Jia

Existing contrastive language-image pre-training aims to learn a joint representation by matching abundant image-text pairs. However, the number of image-text pairs in medical datasets is usually orders of magnitude smaller than that in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Jiarun Liu , Hong-Yu Zhou , Cheng Li , Weijian Huang , Hao Yang , Yong Liang , Shanshan Wang

Weakly supervised text-based person retrieval seeks to retrieve images of a target person using textual descriptions, without relying on identity annotations and is more challenging and practical. The primary challenge is the intra-class…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Xinpeng Zhao , Yanwei Zheng , Chuanlin Lan , Xiaowei Zhang , Bowen Huang , Jibin Yang , Dongxiao Yu

Contrastive vision-language models continue to be the dominant approach for image and text retrieval. Contrastive Language-Image Pre-training (CLIP) trains two neural networks in contrastive manner to align their image and text embeddings…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kwun Ho Ngan , Saman Sadeghi Afgeh , Joe Townsend , Artur d'Avila Garcez

Modern Web systems such as social media and e-commerce contain rich contents expressed in images and text. Leveraging information from multi-modalities can improve the performance of machine learning tasks such as classification and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Huidong Liu , Shaoyuan Xu , Jinmiao Fu , Yang Liu , Ning Xie , Chien-Chih Wang , Bryan Wang , Yi Sun

Visual speech recognition (VSR), also known as lip reading, is the task of recognizing speech from silent video. Despite significant advancements in VSR over recent decades, most existing methods pay limited attention to real-world visual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Tianyue Wang , Shuang Yang , Shiguang Shan , Xilin Chen

Image-text retrieval is a central problem for understanding the semantic relationship between vision and language, and serves as the basis for various visual and language tasks. Most previous works either simply learn coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chong Liu , Yuqi Zhang , Hongsong Wang , Weihua Chen , Fan Wang , Yan Huang , Yi-Dong Shen , Liang Wang

Contrastive Language-Image Pre-training (CLIP) has been a celebrated method for training vision encoders to generate image/text representations facilitating various applications. Recently, CLIP has been widely adopted as the vision backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Hong-You Chen , Zhengfeng Lai , Haotian Zhang , Xinze Wang , Marcin Eichner , Keen You , Meng Cao , Bowen Zhang , Yinfei Yang , Zhe Gan

Text-Based Person Search (TBPS) aims to retrieve target person images from a large-scale gallery using natural language descriptions, posing fundamental challenges in cross-modal representation learning. Existing methods often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jing Liu , Donglai Wei , Yang Liu , Sipeng Zhang , Tong Yang , Wei Zhou , Weiping Ding , Victor C. M. Leung

Vision-language foundation models, represented by Contrastive Language-Image Pre-training (CLIP), have gained increasing attention for jointly understanding both vision and textual tasks. However, existing approaches primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bowen Shi , Peisen Zhao , Zichen Wang , Yuhang Zhang , Yaoming Wang , Jin Li , Wenrui Dai , Junni Zou , Hongkai Xiong , Qi Tian , Xiaopeng Zhang

Contrastive Language-Image Pre-training, benefiting from large-scale unlabeled text-image pairs, has demonstrated great performance in open-world vision understanding tasks. However, due to the limited Text-3D data pairs, adapting the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yihan Zeng , Chenhan Jiang , Jiageng Mao , Jianhua Han , Chaoqiang Ye , Qingqiu Huang , Dit-Yan Yeung , Zhen Yang , Xiaodan Liang , Hang Xu