English
Related papers

Related papers: CLIP-PAE: Projection-Augmentation Embedding to Ext…

200 papers

To achieve disentangled image manipulation, previous works depend heavily on manual annotation. Meanwhile, the available manipulations are limited to a pre-defined set the models were trained for. We propose a novel framework, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Zipeng Xu , Tianwei Lin , Hao Tang , Fu Li , Dongliang He , Nicu Sebe , Radu Timofte , Luc Van Gool , Errui Ding

Remote sensing image-text retrieval plays a crucial role in remote sensing interpretation, yet remains challenging under both closed-domain and open-domain scenarios due to semantic noise and domain shifts. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Jiancheng Pan , Muyuan Ma , Qing Ma , Cong Bai , Shengyong Chen

Contrastive Language-Image Pre-training (CLIP) has been a celebrated method for training vision encoders to generate image/text representations facilitating various applications. Recently, CLIP has been widely adopted as the vision backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Hong-You Chen , Zhengfeng Lai , Haotian Zhang , Xinze Wang , Marcin Eichner , Keen You , Meng Cao , Bowen Zhang , Yinfei Yang , Zhe Gan

Contrastive Language-Image Pre-training (CLIP) has drawn increasing attention recently for its transferable visual representation learning. However, due to the semantic gap within datasets, CLIP's pre-trained image-text alignment becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Longtian Qiu , Renrui Zhang , Ziyu Guo , Ziyao Zeng , Zilu Guo , Yafeng Li , Guangnan Zhang

Contrastive Language-Image Pre-Training (CLIP) is a popular method for learning multimodal latent spaces with well-organized semantics. Despite its wide range of applications, CLIP's latent space is known to fail at handling complex…

Machine Learning · Computer Science 2026-03-17 Raphi Kang , Yue Song , Georgia Gkioxari , Pietro Perona

Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training paradigm, successfully introduces text supervision to vision models. It has shown promising results across various tasks due to its generalizability and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Zihao Zhao , Yuxiao Liu , Han Wu , Mei Wang , Yonghao Li , Sheng Wang , Lin Teng , Disheng Liu , Zhiming Cui , Qian Wang , Dinggang Shen

In this paper, we explore the potential of Vision-Language Models (VLMs), specifically CLIP, in predicting visual object relationships, which involves interpreting visual features from images into language-based relations. Current…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Rakshith Subramanyam , T. S. Jayram , Rushil Anirudh , Jayaraman J. Thiagarajan

Language-image pre-training is an effective technique for learning powerful representations in general domains. However, when directly turning to person representation learning, these general pre-training methods suffer from unsatisfactory…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jialong Zuo , Jiahao Hong , Feng Zhang , Changqian Yu , Hanyu Zhou , Changxin Gao , Nong Sang , Jingdong Wang

Contrastive Language and Image Pairing (CLIP), a transformative method in multimedia retrieval, typically trains two neural networks concurrently to generate joint embeddings for text and image pairs. However, when applied directly, these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Konstantin Schall , Kai Uwe Barthel , Nico Hezel , Klaus Jung

Contrastive Language-Image Pre-training (CLIP) learns rich representations via readily available supervision of natural language. It improves the performance of downstream vision tasks, including but not limited to the zero-shot, long tail,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yi Li , Hualiang Wang , Yiqun Duan , Hang Xu , Xiaomeng Li

Image enhancement is a significant research area in the fields of computer vision and image processing. In recent years, many learning-based methods for image enhancement have been developed, where the Look-up-table (LUT) has proven to be…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Weiwen Chen , Qiuhong Ke , Zinuo Li

In this paper we propose a novel modification of Contrastive Language-Image Pre-Training (CLIP) guidance for the task of unsupervised backlit image enhancement. Our work builds on the state-of-the-art CLIP-LIT approach, which learns a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Tatiana Gaintseva , Martin Benning , Gregory Slabaugh

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable performance in various multimodal tasks. However, it still struggles with compositional image-text matching, particularly in accurately associating objects with their…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Qi Zhang , Yuxu Chen , Lei Deng , Lili Shen

Contrastive language-image pre-training (CLIP) is a powerful vision-language model that has shown great benefits for various tasks. However, we have identified some issues with its explainability, which undermine its credibility and limit…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yi Li , Hualiang Wang , Yiqun Duan , Jiheng Zhang , Xiaomeng Li

The large-scale visual-language pre-trained model, Contrastive Language-Image Pre-training (CLIP), has significantly improved image captioning for scenarios without human-annotated image-caption pairs. Recent advanced CLIP-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Jiarui Yu , Haoran Li , Yanbin Hao , Bin Zhu , Tong Xu , Xiangnan He

Contrastive Language-Image Pre-training (CLIP) represents the latest incarnation of pre-trained vision-language models. Although CLIP has recently shown its superior power on a wide range of downstream vision-language tasks like Visual…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sinuo Deng , Lifang Wu , Ge Shi , Lehao Xing , Meng Jian , Ye Xiang

Recent progress has shown that large-scale pre-training using contrastive image-text pairs can be a promising alternative for high-quality visual representation learning from natural language supervision. Benefiting from a broader source of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yongming Rao , Wenliang Zhao , Guangyi Chen , Yansong Tang , Zheng Zhu , Guan Huang , Jie Zhou , Jiwen Lu

Learning generalized representations from limited training samples is crucial for applying deep neural networks in low-resource scenarios. Recently, methods based on Contrastive Language-Image Pre-training (CLIP) have exhibited promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yao Zhu , Yuefeng Chen , Wei Wang , Xiaofeng Mao , Xiu Yan , Yue Wang , Zhigang Li , Wang lu , Jindong Wang , Xiangyang Ji

Vision-language models (VLMs) such as CLIP are trained via contrastive learning between text and image pairs, resulting in aligned image and text embeddings that are useful for many downstream tasks. A notable drawback of CLIP, however, is…

Machine Learning · Computer Science 2025-07-08 Dylan Sam , Devin Willmott , Joao D. Semedo , J. Zico Kolter

We propose a novel unsupervised backlit image enhancement method, abbreviated as CLIP-LIT, by exploring the potential of Contrastive Language-Image Pre-Training (CLIP) for pixel-level image enhancement. We show that the open-world CLIP…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Zhexin Liang , Chongyi Li , Shangchen Zhou , Ruicheng Feng , Chen Change Loy
‹ Prev 1 2 3 10 Next ›