English
Related papers

Related papers: Detecting AI-Generated Images via CLIP

200 papers

Recent advancements in Artificial Intelligence have led to remarkable improvements in generating realistic human faces. While these advancements demonstrate significant progress in generative models, they also raise concerns about the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Jin Huang , Subhadra Gopalakrishnan , Trisha Mittal , Jake Zuena , Jaclyn Pytlarz

Recently, AI-generated images (AIGIs) created by given prompts (initial prompts) have garnered widespread attention. Nevertheless, due to technical nonproficiency, they often suffer from poor perception quality and Text-to-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jili Xia , Lihuo He , Fei Gao , Kaifan Zhang , Leida Li , Xinbo Gao

Rich feature representations derived from CLIP-ViT have been widely utilized in AI-generated image detection. While most existing methods primarily leverage features from the final layer, we systematically analyze the contributions of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 NaHyeon Park , Kunhee Kim , Junsuk Choe , Hyunjung Shim

With advances in generative artificial intelligence (AI), it is now possible to produce realistic-looking automated reports for preliminary reads of radiology images. This can expedite clinical workflows, improve accuracy and reduce overall…

Artificial Intelligence · Computer Science 2025-06-03 Razi Mahmood , Diego Machado Reyes , Ge Wang , Mannudeep Kalra , Pingkun Yan

Generative AI models can produce high-quality images based on text prompts. The generated images often appear indistinguishable from images generated by conventional optical photography devices or created by human artists (i.e., real…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yuying Li , Zeyan Liu , Junyi Zhao , Liangqin Ren , Fengjun Li , Jiebo Luo , Bo Luo

Text-guided image generation aimed to generate desired images conditioned on given texts, while text-guided image manipulation refers to semantically edit parts of a given image based on specified texts. For these two similar tasks, the key…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Xiaozhou You , Jian Zhang

The rapid development of AI-generated content (AIGC) technology has led to the misuse of highly realistic AI-generated images (AIGI) in spreading misinformation, posing a threat to public information security. Although existing AIGI…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ziyin Zhou , Yunpeng Luo , Yuanchen Wu , Ke Sun , Jiayi Ji , Ke Yan , Shouhong Ding , Xiaoshuai Sun , Yunsheng Wu , Rongrong Ji

In AI-generated image detection, current cutting-edge methods typically adapt pre-trained foundation models through partial-parameter fine-tuning. However, these approaches often struggle to generalize to forgeries from unseen generators,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Yiheng Li , Zichang Tan , Guoqing Xu , Zhen Lei , Xu Zhou , Yang Yang

In the rapidly evolving field of Artificial Intelligence Generated Content (AIGC), a central challenge is distinguishing AI-synthesized images from natural ones. Despite the impressive capabilities of advanced generative models in producing…

Artificial Intelligence · Computer Science 2025-08-12 Renyang Liu , Ziyu Lyu , Wei Zhou , See-Kiong Ng

The CLIP (Contrastive Language-Image Pre-training) model and its variants are becoming the de facto backbone in many applications. However, training a CLIP model from hundreds of millions of image-text pairs can be prohibitively expensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Liangliang Cao , Bowen Zhang , Chen Chen , Yinfei Yang , Xianzhi Du , Wencong Zhang , Zhiyun Lu , Yantao Zheng

Generative AI technologies produce increasingly realistic imagery, which, despite its potential for creative applications, can also be misused to produce misleading and harmful content. This renders Synthetic Image Detection (SID) methods…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Despina Konstantinidou , Christos Koutlis , Symeon Papadopoulos

AI in dermatology is evolving at a rapid pace but the major limitation to training trustworthy classifiers is the scarcity of data with ground-truth concept level labels, which are meta-labels semantically meaningful to humans. Foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Soham Gadgil , Mahtab Bigverdi

This expository paper introduces a simplified approach to image-based quality inspection in manufacturing using OpenAI's CLIP (Contrastive Language-Image Pretraining) model adapted for few-shot learning. While CLIP has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Fadel M. Megahed , Ying-Ju Chen , Bianca Maria Colosimo , Marco Luigi Giuseppe Grasso , L. Allison Jones-Farmer , Sven Knoth , Hongyue Sun , Inez Zwetsloot

Contrastive Language and Image Pairing (CLIP), a transformative method in multimedia retrieval, typically trains two neural networks concurrently to generate joint embeddings for text and image pairs. However, when applied directly, these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Konstantin Schall , Kai Uwe Barthel , Nico Hezel , Klaus Jung

Person re-identification (ReID) has recently benefited from large pretrained vision-language models such as Contrastive Language-Image Pre-Training (CLIP). However, the absence of concrete descriptions necessitates the use of implicit text…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Qianru Han , Xinwei He , Zhi Liu , Sannyuya Liu , Ying Zhang , Jinhai Xiang

Recently, there have been breakthroughs in computer vision ("CV") models that are more generalizable with the advent of models such as CLIP and ALIGN. In this paper, we analyze CLIP and highlight some of the challenges such models pose.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Sandhini Agarwal , Gretchen Krueger , Jack Clark , Alec Radford , Jong Wook Kim , Miles Brundage

One of the key challenges of detecting AI-generated images is spotting images that have been created by previously unseen generative models. We argue that the limited diversity of the training data is a major obstacle to addressing this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Jeongsoo Park , Andrew Owens

Contrastive language-image pre-training (CLIP) is a powerful vision-language model that has shown great benefits for various tasks. However, we have identified some issues with its explainability, which undermine its credibility and limit…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yi Li , Hualiang Wang , Yiqun Duan , Jiheng Zhang , Xiaomeng Li

The rapid progress of generative models such as GANs and diffusion models has led to the widespread proliferation of AI-generated images, raising concerns about misinformation, privacy violations, and trust erosion in digital media.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Jiazhen Yan , Ziqiang Li , Fan Wang , Boyu Wang , Ziwen He , Zhangjie Fu

Contrastive Language-Image Pre-training (CLIP) has become a foundation model and has been applied to various vision and multimodal tasks. However, recent works indicate that CLIP falls short in distinguishing detailed differences in images…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Yinqi Li , Jiahe Zhao , Hong Chang , Ruibing Hou , Shiguang Shan , Xilin Chen