中文
相关论文

相关论文: CLIP Unreasonable Potential in Single-Shot Face Re…

200 篇论文

Image captioning models are usually trained according to human annotated ground-truth captions, which could generate accurate but generic captions. In this paper, we focus on generating distinctive captions that can distinguish the target…

计算机视觉与模式识别 · 计算机科学 2022-08-30 Youyuan Zhang , Jiuniu Wang , Hao Wu , Wenjia Xu

Contrastive Language-Image Pre-training (CLIP) learns rich representations via readily available supervision of natural language. It improves the performance of downstream vision tasks, including but not limited to the zero-shot, long tail,…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Yi Li , Hualiang Wang , Yiqun Duan , Hang Xu , Xiaomeng Li

We propose a novel unsupervised backlit image enhancement method, abbreviated as CLIP-LIT, by exploring the potential of Contrastive Language-Image Pre-Training (CLIP) for pixel-level image enhancement. We show that the open-world CLIP…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Zhexin Liang , Chongyi Li , Shangchen Zhou , Ruicheng Feng , Chen Change Loy

"Frontalization" is the process of synthesizing frontal facing views of faces appearing in single unconstrained photos. Recent reports have suggested that this process may substantially boost the performance of face recognition systems.…

计算机视觉与模式识别 · 计算机科学 2014-12-01 Tal Hassner , Shai Harel , Eran Paz , Roee Enbar

Existing vision-language models (VLMs) such as CLIP have showcased an impressive capability to generalize well across various downstream tasks. These models leverage the synergy between visual and textual information, enabling them to…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Fangming Cui , Yonggang Zhang , Xuan Wang , Xule Wang , Liang Xiao

Human-centric visual analysis plays a pivotal role in diverse applications, including surveillance, healthcare, and human-computer interaction. With the emergence of large-scale unlabeled human image datasets, there is an increasing need…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Mingshuang Luo , Ruibing Hou , Bo Chao , Hong Chang , Zimo Liu , Yaowei Wang , Shiguang Shan

Recent progress has shown that large-scale pre-training using contrastive image-text pairs can be a promising alternative for high-quality visual representation learning from natural language supervision. Benefiting from a broader source of…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Yongming Rao , Wenliang Zhao , Guangyi Chen , Yansong Tang , Zheng Zhu , Guan Huang , Jie Zhou , Jiwen Lu

The age estimation task aims to predict the age of an individual by analyzing facial features in an image. The development of age estimation can improve the efficiency and accuracy of various applications (e.g., age verification and secure…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Yuntao Shou , Wei Ai , Tao Meng , Nan Yin , Keqin Li

Recent advances in contrastive language-image pretraining (CLIP) have demonstrated strong capabilities in zero-shot classification by aligning visual representations with target text embeddings in an image level. However, in dense…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Feng Wang , Jieru Mei , Alan Yuille

Treating texts as images, combining prompts with textual labels for prompt tuning, and leveraging the alignment properties of CLIP have been successfully applied in zero-shot multi-label image recognition. Nonetheless, relying solely on…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Haonan Xu , Dian Chao , Xiangyu Wu , Zhonghua Wan , Yang Yang

Image captioning is a fundamental task in vision-language understanding, where the model predicts a textual informative caption to a given input image. In this paper, we present a simple approach to address this task. We use CLIP encoding…

计算机视觉与模式识别 · 计算机科学 2021-11-19 Ron Mokady , Amir Hertz , Amit H. Bermano

One-shot face recognition measures the ability to identify persons with only seeing them at one glance, and is a hallmark of human visual intelligence. It is challenging for conventional machine learning approaches to mimic this way, since…

计算机视觉与模式识别 · 计算机科学 2019-10-14 Zhengming Ding , Yandong Guo , Lei Zhang , Yun Fu

The application of zero-shot learning in computer vision has been revolutionized by the use of image-text matching models. The most notable example, CLIP, has been widely used for both zero-shot classification and guiding generative models…

计算机视觉与模式识别 · 计算机科学 2022-08-09 Roni Paiss , Hila Chefer , Lior Wolf

Visual language models like Contrastive Language-Image Pretraining (CLIP) have shown impressive performance in analyzing natural images with language information. However, these models often encounter challenges when applied to specialized…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Jiaqing Zhang , Mingxiang Cao , Xue Yang , Kai Jiang , Yunsong Li

Contrastive vision-language models continue to be the dominant approach for image and text retrieval. Contrastive Language-Image Pre-training (CLIP) trains two neural networks in contrastive manner to align their image and text embeddings…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Kwun Ho Ngan , Saman Sadeghi Afgeh , Joe Townsend , Artur d'Avila Garcez

Contrastive Language-Image Pre-Training (CLIP) is a popular method for learning multimodal latent spaces with well-organized semantics. Despite its wide range of applications, CLIP's latent space is known to fail at handling complex…

机器学习 · 计算机科学 2026-03-17 Raphi Kang , Yue Song , Georgia Gkioxari , Pietro Perona

Contrastive Language-Image Pre-training (CLIP) on large-scale image-caption datasets learns representations that can achieve remarkable zero-shot generalization. However, such models require a massive amount of pre-training data. Improving…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Siddharth Joshi , Arnav Jain , Ali Payani , Baharan Mirzasoleiman

Contrastive Language-Image Pre-training (CLIP) models have demonstrated superior performance across various visual tasks including medical image classification. However, fairness concerns, including demographic biases, have received limited…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Chenlang Yi , Zizhan Xiong , Qi Qi , Xiyuan Wei , Girish Bathla , Ching-Long Lin , Bobak Jack Mortazavi , Tianbao Yang

Verifying the authenticity of AI-generated images presents a growing challenge on social media platforms these days. While vision-language models (VLMs) like CLIP outdo in multimodal representation, their capacity for AI-generated image…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Ziyang Ou

Contrastive Language-Image Pre-training (CLIP) models have demonstrated remarkable generalization capabilities across multiple challenging distribution shifts. However, there is still much to be explored in terms of their robustness to the…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Weijie Tu , Weijian Deng , Tom Gedeon