English
Related papers

Related papers: CLIP-DFGS: A Hard Sample Mining Method for CLIP in…

200 papers

Vision-Language Pre-training (VLP) models like CLIP have significantly advanced Remote Sensing Image-Text Retrieval (RSITR). However, existing methods predominantly rely on coarse-grained global alignment, which often overlooks the dense,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifan Li , Shiying Wang , Jianqiang Huang

The recent years have witnessed the remarkable development for open-vocabulary semantic segmentation (OVSS) using visual-language foundation models, yet still suffer from following fundamental challenges: (1) insufficient cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jing Wang , Huimin Shi , Quan Zhou , Qibo Liu , Suofei Zhang , Huimin Lu

Contrastive Language-Image Pre-training (CLIP) has been the cornerstone for zero-shot classification, text-image retrieval, and text-image generation by aligning image and text modalities. Despite its widespread adoption, a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Beichen Zhang , Pan Zhang , Xiaoyi Dong , Yuhang Zang , Jiaqi Wang

Despite the success of large-scale pretrained Vision-Language Models (VLMs) especially CLIP in various open-vocabulary tasks, their application to semantic segmentation remains challenging, producing noisy segmentation maps with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Mengcheng Lan , Chaofeng Chen , Yiping Ke , Xinjiang Wang , Litong Feng , Wayne Zhang

In video surveillance applications, person search is a challenging task consisting in detecting people and extracting features from their silhouette for re-identification (re-ID) purpose. We propose a new end-to-end model that jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Angelique Loesch , Jaonary Rabarisoa , Romaric Audigier

Person re-identification aims to match a person's identity across multiple camera streams. Deep neural networks have been successfully applied to the challenging person re-identification task. One remarkable bottleneck is that the existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Guodong Ding , Shanshan Zhang , Salman Khan , Zhenmin Tang , Jian Zhang , Fatih Porikli

We investigate the success conditions for compositional generalization of CLIP models on real-world data through performance prediction. Prior work shows that CLIP requires exponentially more pretraining data for linear performance gains on…

Machine Learning · Computer Science 2025-02-26 Thaddäus Wiedemer , Yash Sharma , Ameya Prabhu , Matthias Bethge , Wieland Brendel

Contrastive image-text models such as CLIP form the building blocks of many state-of-the-art systems. While they excel at recognizing common generic concepts, they still struggle on fine-grained entities which are rare, or even absent from…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Ahmet Iscen , Mathilde Caron , Alireza Fathi , Cordelia Schmid

Blind dehazed image quality assessment (BDQA), which aims to accurately predict the visual quality of dehazed images without any reference information, is essential for the evaluation, comparison, and optimization of image dehazing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yirui Zeng , Jun Fu , Hadi Amirpour , Huasheng Wang , Guanghui Yue , Hantao Liu , Ying Chen , Wei Zhou

Label estimation is an important component in an unsupervised person re-identification (re-ID) system. This paper focuses on cross-camera label estimation, which can be subsequently used in feature learning to learn robust re-ID models.…

Computer Vision and Pattern Recognition · Computer Science 2017-09-28 Mang Ye , Andy J Ma , Liang Zheng , Jiawei Li , P C Yuen

Weakly supervised text-based person retrieval seeks to retrieve images of a target person using textual descriptions, without relying on identity annotations and is more challenging and practical. The primary challenge is the intra-class…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Xinpeng Zhao , Yanwei Zheng , Chuanlin Lan , Xiaowei Zhang , Bowen Huang , Jibin Yang , Dongxiao Yu

Contrastive Language-Image Pre-training (CLIP), which excels at abstracting open-world representations across domains and modalities, has become a foundation for a variety of vision and multimodal tasks. However, recent studies reveal that…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Wenxuan Wang , Quan Sun , Fan Zhang , Yepeng Tang , Jing Liu , Xinlong Wang

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yu Zhang , Qi Zhang , Zixuan Gong , Yiwei Shi , Yepeng Liu , Duoqian Miao , Yang Liu , Ke Liu , Kun Yi , Wei Fan , Liang Hu , Changwei Wang

In person re-identification (ReID) tasks, many works explore the learning of part features to improve the performance over global image features. Existing methods explicitly extract part features by either using a hand-designed image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Dengjie Li , Siyu Chen , Yujie Zhong , Lin Ma

Aiming at improving performance of visual classification in a cost-effective manner, this paper proposes an incremental semi-supervised learning paradigm called Deep Co-Space (DCS). Unlike many conventional semi-supervised learning methods…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Ziliang Chen , Keze Wang , Xiao Wang , Pai Peng , Ebroul Izquierdo , Liang Lin

Recent vision-language models outperform vision-only models on many image classification tasks. However, because of the absence of paired text/image descriptions, it remains difficult to fine-tune these models for fine-grained image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Kathleen M. Lewis , Emily Mu , Adrian V. Dalca , John Guttag

Modern applications increasingly demand flexible computer vision models that adapt to novel concepts not encountered during training. This necessity is pivotal in emerging domains like extended reality, robotics, and autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Lorenzo Bianchi , Fabio Carrara , Nicola Messina , Fabrizio Falchi

Medical image segmentation remains challenging due to limited annotations for training, ambiguous anatomical features, and domain shifts. While vision-language models such as CLIP offer strong cross-modal representations, their potential…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Taha Koleilat , Hojat Asgariandehkordi , Omid Nejati Manzari , Berardino Barile , Yiming Xiao , Hassan Rivaz

Person re-identification (ReID) is aimed at identifying the same person across videos captured from different cameras. In the view that networks extracting global features using ordinary network architectures are difficult to extract local…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Pengyuan Ren , Jianmin Li

CLIP models perform remarkably well on zero-shot classification and retrieval tasks. But recent studies have shown that learnt representations in CLIP are not well suited for dense prediction tasks like object detection, semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Pavan Kumar Anasosalu Vasu , Hadi Pouransari , Fartash Faghri , Oncel Tuzel