中文
相关论文

相关论文: C2P-CLIP: Injecting Category Common Prompt in CLIP…

200 篇论文

Contrastive Language-Image Pre-training (CLIP) has demonstrated outstanding performance in global image understanding and zero-shot transfer through large-scale text-image alignment. However, the core of medical image analysis often lies in…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Jiahui Peng , He Yao , Jingwen Li , Yanzhou Su , Sibo Ju , Yujie Lu , Jin Ye , Hongchun Lu , Xue Li , Lincheng Jiang , Min Zhu , Junlong Cheng

Dense visual perception tasks have been constrained by their reliance on predefined categories, limiting their applicability in real-world scenarios where visual concepts are unbounded. While Vision-Language Models (VLMs) like CLIP have…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Junjie Wang , Keyu Chen , Yulin Li , Bin Chen , Hengshuang Zhao , Xiaojuan Qi , Zhuotao Tian

Contrastive Language-Image Pre-training (CLIP) has been the cornerstone for zero-shot classification, text-image retrieval, and text-image generation by aligning image and text modalities. Despite its widespread adoption, a significant…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Beichen Zhang , Pan Zhang , Xiaoyi Dong , Yuhang Zang , Jiaqi Wang

Text-to-image diffusion models have shown remarkable capabilities of generating high-quality images closely aligned with textual inputs. However, the effectiveness of text guidance heavily relies on the CLIP text encoder, which is trained…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Zexi Jia , Chuanwei Huang , Hongyan Fei , Yeshuang Zhu , Zhiqiang Yuan , Jinchao Zhang , Jie Zhou

Contrastive language-image pre-training (CLIP) models have demonstrated considerable success across various vision-language tasks, such as text-to-image retrieval, where the model is required to effectively process natural language input to…

计算机视觉与模式识别 · 计算机科学 2024-02-26 Hyunjae Kim , Seunghyun Yoon , Trung Bui , Handong Zhao , Quan Tran , Franck Dernoncourt , Jaewoo Kang

The rapid development of photo-realistic face generation methods has raised significant concerns in society and academia, highlighting the urgent need for robust and generalizable face forgery detection (FFD) techniques. Although existing…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Yaning Zhang , Tianyi Wang , Zitong Yu , Zan Gao , Linlin Shen , Shengyong Chen

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Naresh Kumar Lahajal , Harini S

We describe Forensics Adapter, an adapter network designed to transform CLIP into an effective and generalizable face forgery detector. Although CLIP is highly versatile, adapting it for face forgery detection is non-trivial as…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Xinjie Cui , Yuezun Li , Delong Zhu , Jiaran Zhou , Junyu Dong , Siwei Lyu

Contrastive Language-Image Pre-Training (CLIP) is a popular method for learning multimodal latent spaces with well-organized semantics. Despite its wide range of applications, CLIP's latent space is known to fail at handling complex…

机器学习 · 计算机科学 2026-03-17 Raphi Kang , Yue Song , Georgia Gkioxari , Pietro Perona

Vision-language models like CLIP have demonstrated remarkable zero-shot capabilities in classification and retrieval. However, these models often struggle with compositional reasoning - the ability to understand the relationships between…

机器学习 · 计算机科学 2025-10-29 Amit Peleg , Naman Deep Singh , Matthias Hein

We propose a novel unsupervised backlit image enhancement method, abbreviated as CLIP-LIT, by exploring the potential of Contrastive Language-Image Pre-Training (CLIP) for pixel-level image enhancement. We show that the open-world CLIP…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Zhexin Liang , Chongyi Li , Shangchen Zhou , Ruicheng Feng , Chen Change Loy

The large-scale pretrained model CLIP, trained on 400 million image-text pairs, offers a promising paradigm for tackling vision tasks, albeit at the image level. Later works, such as DenseCLIP and LSeg, extend this paradigm to dense…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Ke Jin , Wankou Yang

The evolution of prompt learning methodologies has driven exploration of deeper prompt designs to enhance model performance. However, current deep text prompting approaches suffer from two critical limitations: Over-reliance on constrastive…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Qiqi Zhan , Shiwei Li , Qingjie Liu , Yunhong Wang

As a pioneering vision-language model, CLIP (Contrastive Language-Image Pre-training) has achieved significant success across various domains and a wide range of downstream vision-language tasks. However, the text encoders in popular CLIP…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Mothilal Asokan , Kebin Wu , Fatima Albreiki

In contrast to the incremental classification task, the incremental detection task is characterized by the presence of data ambiguity, as an image may have differently labeled bounding boxes across multiple continuous learning stages. This…

计算机视觉与模式识别 · 计算机科学 2024-07-10 Ziyue Huang , Yupeng He , Qingjie Liu , Yunhong Wang

Weakly supervised semantic segmentation (WSSS) with image-level labels is a challenging task. Mainstream approaches follow a multi-stage framework and suffer from high training costs. In this paper, we explore the potential of Contrastive…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Yuqi Lin , Minghao Chen , Wenxiao Wang , Boxi Wu , Ke Li , Binbin Lin , Haifeng Liu , Xiaofei He

Contrastive Language-Image Pre-training (CLIP) represents the latest incarnation of pre-trained vision-language models. Although CLIP has recently shown its superior power on a wide range of downstream vision-language tasks like Visual…

计算机视觉与模式识别 · 计算机科学 2022-05-31 Sinuo Deng , Lifang Wu , Ge Shi , Lehao Xing , Meng Jian , Ye Xiang

The aim of this work is to explore the potential of pre-trained vision-language models (VLMs) for universal detection of AI-generated images. We develop a lightweight detection strategy based on CLIP features and study its performance in a…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Davide Cozzolino , Giovanni Poggi , Riccardo Corvi , Matthias Nießner , Luisa Verdoliva

CLIP models perform remarkably well on zero-shot classification and retrieval tasks. But recent studies have shown that learnt representations in CLIP are not well suited for dense prediction tasks like object detection, semantic…

计算机视觉与模式识别 · 计算机科学 2024-05-16 Pavan Kumar Anasosalu Vasu , Hadi Pouransari , Fartash Faghri , Oncel Tuzel

Vision-language models like CLIP are widely used in zero-shot image classification due to their ability to understand various visual concepts and natural language descriptions. However, how to fully leverage CLIP's unprecedented human-like…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Bang An , Sicheng Zhu , Michael-Andrei Panaitescu-Liess , Chaithanya Kumar Mummadi , Furong Huang