English
Related papers

Related papers: CLIP Unreasonable Potential in Single-Shot Face Re…

200 papers

Leveraging StyleGAN's expressivity and its disentangled latent codes, existing methods can achieve realistic editing of different visual attributes such as age and gender of facial images. An intriguing yet challenging problem arises: Can…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Yingchen Yu , Fangneng Zhan , Rongliang Wu , Jiahui Zhang , Shijian Lu , Miaomiao Cui , Xuansong Xie , Xian-Sheng Hua , Chunyan Miao

The Contrastive Language-Image Pre-training (CLIP) has recently shown remarkable generalization on "zero-shot" training and has applied to many downstream tasks. We explore the adaptation of CLIP to achieve a more efficient and generalized…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Qiang Wang , Junlong Du , Ke Yan , Shouhong Ding

Contrastive Language-Image Pretraining (CLIP) efficiently learns visual concepts by pre-training with natural language supervision. CLIP and its visual encoder have been explored on various vision and language tasks and achieve strong…

Computation and Language · Computer Science 2022-10-13 An Yan , Jiacheng Li , Wanrong Zhu , Yujie Lu , William Yang Wang , Julian McAuley

Contrastive Language-Image Pre-training (CLIP) stands as one of the most effective and scalable methods for training transferable vision models using paired image and text data. CLIP models are trained using contrastive loss, which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Lijie Fan , Dilip Krishnan , Phillip Isola , Dina Katabi , Yonglong Tian

Facial expression recognition (FER) is an essential task for understanding human behaviors. As one of the most informative behaviors of humans, facial expressions are often compound and variable, which is manifested by the fact that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Hanting Li , Hongjing Niu , Zhaoqing Zhu , Feng Zhao

Recent advancements in Contrastive Language-Image Pre-training (CLIP) have demonstrated notable success in self-supervised representation learning across various tasks. However, the existing CLIP-like approaches often demand extensive GPU…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Yuexi Du , Brian Chang , Nicha C. Dvornek

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yu Zhang , Qi Zhang , Zixuan Gong , Yiwei Shi , Yepeng Liu , Duoqian Miao , Yang Liu , Ke Liu , Kun Yi , Wei Fan , Liang Hu , Changwei Wang

The popularity of Contrastive Language-Image Pre-training (CLIP) has propelled its application to diverse downstream vision tasks. To improve its capacity on downstream tasks, few-shot learning has become a widely-adopted technique.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Xiangyang Zhu , Renrui Zhang , Bowei He , Aojun Zhou , Dong Wang , Bin Zhao , Peng Gao

Contrastive Language-Image Pre-training (CLIP) models have shown significant potential, particularly in zero-shot classification across diverse distribution shifts. Building on existing evaluations of overall classification robustness, this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Weijie Tu , Weijian Deng , Tom Gedeon

Human action recognition plays a critical role in healthcare and medicine, supporting applications such as patient behavior monitoring, fall detection, surgical robot supervision, and procedural skill assessment. While traditional models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Utkarsh Shandilya , Marsha Mariya Kappan , Sanyam Jain , Vijeta Sharma

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object localization…

Contrastive Language-Image Pre-training (CLIP)~\citep{radford2021learning} has emerged as a pivotal model in computer vision and multimodal learning, achieving state-of-the-art performance at aligning visual and textual representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Shaoan Xie , Lingjing Kong , Yujia Zheng , Yu Yao , Zeyu Tang , Eric P. Xing , Guangyi Chen , Kun Zhang

CLIP (Contrastive Language-Image Pre-training) has attained great success in pattern recognition and computer vision. Transferring CLIP to downstream tasks (e.g. zero- or few-shot classification) is a hot topic in multimodal learning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhipeng Ye , Feng Jiang , Qiufeng Wang , Kaizhu Huang , Jiaqi Huang

We present RECLIP (Resource-efficient CLIP), a simple method that minimizes computational resource footprint for CLIP (Contrastive Language Image Pretraining). Inspired by the notion of coarse-to-fine in computer vision, we leverage small…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Runze Li , Dahun Kim , Bir Bhanu , Weicheng Kuo

Contrastive Language-Image Pre-training (CLIP) has been a celebrated method for training vision encoders to generate image/text representations facilitating various applications. Recently, CLIP has been widely adopted as the vision backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Hong-You Chen , Zhengfeng Lai , Haotian Zhang , Xinze Wang , Marcin Eichner , Keen You , Meng Cao , Bowen Zhang , Yinfei Yang , Zhe Gan

Person re-identification (ReID) has recently benefited from large pretrained vision-language models such as Contrastive Language-Image Pre-Training (CLIP). However, the absence of concrete descriptions necessitates the use of implicit text…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Qianru Han , Xinwei He , Zhi Liu , Sannyuya Liu , Ying Zhang , Jinhai Xiang

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Contrastive Language and Image Pairing (CLIP), a transformative method in multimedia retrieval, typically trains two neural networks concurrently to generate joint embeddings for text and image pairs. However, when applied directly, these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Konstantin Schall , Kai Uwe Barthel , Nico Hezel , Klaus Jung

Contrastive Language-Image Pre-training (CLIP) has been the cornerstone for zero-shot classification, text-image retrieval, and text-image generation by aligning image and text modalities. Despite its widespread adoption, a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Beichen Zhang , Pan Zhang , Xiaoyi Dong , Yuhang Zang , Jiaqi Wang

CLIP models learn transferable multi-modal features via image-text contrastive learning on internet-scale data. They are widely used in zero-shot classification, multi-modal retrieval, text-to-image diffusion, and as image encoders in large…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Marc-Antoine Lavoie , Anas Mahmoud , Aldo Zaimi , Arsene Fansi Tchango , Steven L. Waslander