English
Related papers

Related papers: CLIP-DFGS: A Hard Sample Mining Method for CLIP in…

200 papers

We describe Forensics Adapter, an adapter network designed to transform CLIP into an effective and generalizable face forgery detector. Although CLIP is highly versatile, adapting it for face forgery detection is non-trivial as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Xinjie Cui , Yuezun Li , Delong Zhu , Jiaran Zhou , Junyu Dong , Siwei Lyu

Face recognition is a core task in computer vision designed to identify and authenticate individuals by analyzing facial patterns and features. This field intersects with artificial intelligence image processing and machine learning with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Nhan T. Luu

While the Contrastive Language-Image Pretraining(CLIP) model has achieved remarkable success in a variety of downstream vison language understanding tasks, enhancing its capability for fine-grained image-text alignment remains an active…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Yicheng Xiao , Yu Chen , Haoxuan Ma , Jiale Hong , Caorui Li , Lingxiang Wu , Haiyun Guo , Jinqiao Wang

The surge in multimodal AI's success has sparked concerns over data privacy in vision-and-language tasks. While CLIP has revolutionized multimodal learning through joint training on images and text, its potential to unintentionally disclose…

Machine Learning · Computer Science 2024-03-04 Alyssa Huang , Peihan Liu , Ryumei Nakada , Linjun Zhang , Wanrong Zhang

The recent advancements in Generative Adversarial Networks (GANs) and the emergence of Diffusion models have significantly streamlined the production of highly realistic and widely accessible synthetic content. As a result, there is a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Sohail Ahmed Khan , Duc-Tien Dang-Nguyen

Recently, large-scale vision-language pre-trained models like CLIP have shown impressive performance in image re-identification (ReID). In this work, we explore whether self-supervision can aid in the use of CLIP for image ReID tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Bin Wang , Yuying Liang , Lei Cai , Huakun Huang , Huanqiang Zeng

Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training paradigm, successfully introduces text supervision to vision models. It has shown promising results across various tasks due to its generalizability and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Zihao Zhao , Yuxiao Liu , Han Wu , Mei Wang , Yonghao Li , Sheng Wang , Lin Teng , Disheng Liu , Zhiming Cui , Qian Wang , Dinggang Shen

Detecting face forgeries using CLIP has recently emerged as a promising and increasingly popular research direction. Owing to its rich visual knowledge acquired through large-scale pretraining, most existing methods typically rely on the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Enrui Yang , Yuezun Li

CLIP models learn transferable multi-modal features via image-text contrastive learning on internet-scale data. They are widely used in zero-shot classification, multi-modal retrieval, text-to-image diffusion, and as image encoders in large…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Marc-Antoine Lavoie , Anas Mahmoud , Aldo Zaimi , Arsene Fansi Tchango , Steven L. Waslander

Federated learning (FL) provides a decentralized machine learning paradigm where a server collaborates with a group of clients to learn a global model without accessing the clients' data. User heterogeneity is a significant challenge for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jiangming Shi , Shanshan Zheng , Xiangbo Yin , Yang Lu , Yuan Xie , Yanyun Qu

Generative models can create entirely new images, but they can also partially modify real images in ways that are undetectable to the human eye. In this paper, we address the challenge of automatically detecting such local manipulations.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Stefan Smeu , Elisabeta Oneata , Dan Oneata

The Vision-Language Pre-training (VLP) models like CLIP have gained popularity in recent years. However, many works found that the social biases hidden in CLIP easily manifest in downstream tasks, especially in image retrieval, which can…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Junyang Wang , Yi Zhang , Jitao Sang

Dense visual perception tasks have been constrained by their reliance on predefined categories, limiting their applicability in real-world scenarios where visual concepts are unbounded. While Vision-Language Models (VLMs) like CLIP have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Junjie Wang , Keyu Chen , Yulin Li , Bin Chen , Hengshuang Zhao , Xiaojuan Qi , Zhuotao Tian

In this paper we deal with image classification tasks using the powerful CLIP vision-language model. Our goal is to advance the classification performance using the CLIP's image encoder, by proposing a novel Large Multimodal Model (LMM)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Maria Tzelepi , Vasileios Mezaris

Person Re-IDentification (ReID) aims at re-identifying persons from different viewpoints across multiple cameras. Capturing the fine-grained appearance differences is often the key to accurate person ReID, because many identities can be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Cheng Yan , Guansong Pang , Xiao Bai , Jun Zhou , Lin Gu

Contrastive Language-Image Pretraining (CLIP) achieves strong generalization in vision-language tasks by aligning images and texts in a shared embedding space. However, recent findings show that CLIP-like models still underutilize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Weiheng Zhao , Zilong Huang , Jiashi Feng , Xinggang Wang

This work focuses on AIGC detection to develop universal detectors capable of identifying various types of forgery images. Recent studies have found large pre-trained models, such as CLIP, are effective for generalizable deepfake detection…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Chuangchuang Tan , Renshuai Tao , Huan Liu , Guanghua Gu , Baoyuan Wu , Yao Zhao , Yunchao Wei

This paper examines the robustness of a multi-modal computer vision model, CLIP (Contrastive Language-Image Pretraining), in the context of unsupervised learning. The main objective is twofold: first, to evaluate the robustness of CLIP, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Clement Laroudie , Andrei Bursuc , Mai Lan Ha , Gianni Franchi

Cloth-changing person Re-IDentification (Re-ID) is a particularly challenging task, suffering from two limitations of inferior discriminative features and limited training samples. Existing methods mainly leverage auxiliary information to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Qizao Wang , Xuelin Qian , Bin Li , Xiangyang Xue , Yanwei Fu

Person re-identification (re-id), an emerging problem in visual surveillance, deals with maintaining entities of individuals whilst they traverse various locations surveilled by a camera network. From a visual perspective re-id is…

Computer Vision and Pattern Recognition · Computer Science 2015-05-11 Ziming Zhang , Venkatesh Saligrama