English
Related papers

Related papers: CLIP-ReID: Exploiting Vision-Language Model for Im…

200 papers

In contrast to the incremental classification task, the incremental detection task is characterized by the presence of data ambiguity, as an image may have differently labeled bounding boxes across multiple continuous learning stages. This…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Ziyue Huang , Yupeng He , Qingjie Liu , Yunhong Wang

Contrastive Language Image Pre-training (CLIP) has recently demonstrated success across various tasks due to superior feature representation empowered by image-text contrastive learning. However, the instance discrimination method used by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xiang An , Kaicheng Yang , Xiangzi Dai , Ziyong Feng , Jiankang Deng

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

Vision-language models, such as contrastive language-image pre-training (CLIP), have demonstrated impressive results in natural image domains. However, these models often struggle when applied to specialized domains like remote sensing, and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Sangwoo Mo , Minkyu Kim , Kyungmin Lee , Jinwoo Shin

Pre-trained multi-modal Vision-Language Models like CLIP are widely used off-the-shelf for a variety of applications. In this paper, we show that the common practice of individually exploiting the text or image encoders of these powerful…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Marco Mistretta , Alberto Baldrati , Lorenzo Agnolucci , Marco Bertini , Andrew D. Bagdanov

CLIP has shown impressive results in aligning images and texts at scale. However, its ability to capture detailed visual features remains limited because CLIP matches images and texts at a global level. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Rui Xiao , Sanghwan Kim , Mariana-Iuliana Georgescu , Zeynep Akata , Stephan Alaniz

Recent advancements in pre-trained vision-language models like CLIP have shown promise in person re-identification (ReID) applications. However, their performance in generalizable person re-identification tasks remains suboptimal. The…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Huazhong Zhao , Lei Qi , Xin Geng

Contrastive Language-Image Pre-training (CLIP) has achieved excellent performance over a wide range of tasks. However, the effectiveness of CLIP heavily relies on a substantial corpus of pre-training data, resulting in notable consumption…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Kaicheng Yang , Tiancheng Gu , Xiang An , Haiqiang Jiang , Xiangzi Dai , Ziyong Feng , Weidong Cai , Jiankang Deng

Contrastive Language-Image Pre-training (CLIP) has recently shown great promise in pixel-level zero-shot learning tasks. However, existing approaches utilizing CLIP's text and patch embeddings to generate semantic masks often misidentify…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jingyao Li , Pengguang Chen , Shengju Qian , Shu Liu , Jiaya Jia

Contrastive Language-Image Pre-training (CLIP) stands as one of the most effective and scalable methods for training transferable vision models using paired image and text data. CLIP models are trained using contrastive loss, which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Lijie Fan , Dilip Krishnan , Phillip Isola , Dina Katabi , Yonglong Tian

Unsupervised person re-identification (Re-ID) aims to retrieve person images across cameras without any identity labels. Most clustering-based methods roughly divide image features into clusters and neglect the feature distribution noise…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Pengna Li , Kangyi Wu , Sanping Zhou. Qianxin Huang , Jinjun Wang

Contrastive Language-Image Pretraining (CLIP) efficiently learns visual concepts by pre-training with natural language supervision. CLIP and its visual encoder have been explored on various vision and language tasks and achieve strong…

Computation and Language · Computer Science 2022-10-13 An Yan , Jiacheng Li , Wanrong Zhu , Yujie Lu , William Yang Wang , Julian McAuley

Despite recent advances, vision-language models trained with standard contrastive objectives still struggle with compositional reasoning -- the ability to understand structured relationships between visual and linguistic elements. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Jihoon Kwon , Kyle Min , Jy-yong Sohn

Person re-identification (Re-ID) is a crucial task in computer vision, aiming to recognize individuals across non-overlapping camera views. While recent advanced vision-language models (VLMs) excel in logical reasoning and multi-task…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ke Niu , Haiyang Yu , Mengyang Zhao , Teng Fu , Siyang Yi , Wei Lu , Bin Li , Xuelin Qian , Xiangyang Xue

Human intelligence can retrieve any person according to both visual and language descriptions. However, the current computer vision community studies specific person re-identification (ReID) tasks in different scenarios separately, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Weizhen He , Yiheng Deng , Shixiang Tang , Qihao Chen , Qingsong Xie , Yizhou Wang , Lei Bai , Feng Zhu , Rui Zhao , Wanli Ouyang , Donglian Qi , Yunfeng Yan

Referring Image Segmentation (RIS) is a cross-modal task that aims to segment an instance described by a natural language expression. Recent methods leverage large-scale pretrained unimodal models as backbones along with fusion techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Seoyeon Kim , Minguk Kang , Dongwon Kim , Jaesik Park , Suha Kwak

In this paper we deal with image classification tasks using the powerful CLIP vision-language model. Our goal is to advance the classification performance using the CLIP's image encoder, by proposing a novel Large Multimodal Model (LMM)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Maria Tzelepi , Vasileios Mezaris

Existing semantic segmentation approaches are often limited by costly pixel-wise annotations and predefined classes. In this work, we present CLIP-S$^4$ that leverages self-supervised pixel representation learning and vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Wenbin He , Suphanut Jamonnak , Liang Gou , Liu Ren

Extending CLIP models to semantic segmentation remains challenging due to the misalignment between their image-level pre-training objectives and the pixel-level visual understanding required for dense prediction. While prior efforts have…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Jinxin Zhou , Jiachen Jiang , Zhihui Zhu

Despite the success of Vision-Language Models (VLMs) like CLIP in aligning vision and language, their proficiency in detailed, fine-grained visual comprehension remains a key challenge. We present CLIP-IN, a novel framework that bolsters…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ziteng Wang , Siqi Yang , Limeng Qiao , Lin Ma