English
Related papers

Related papers: MFCLIP: Multi-modal Fine-grained CLIP for Generali…

200 papers

As deepfake content proliferates online, advancing face manipulation forensics has become crucial. To combat this emerging threat, previous methods mainly focus on studying how to distinguish authentic and manipulated face images. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Changtao Miao , Qi Chu , Zhentao Tan , Zhenchao Jin , Tao Gong , Wanyi Zhuang , Yue Wu , Bin Liu , Honggang Hu , Nenghai Yu

The rapid evolution of deep generative models poses a critical challenge to deepfake detection, as detectors trained on forgery-specific artifacts often suffer significant performance degradation when encountering unseen forgeries. While…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Mengyu Qiao , Runze Tian , Yang Wang

Currently, the rapid development of computer vision and deep learning has enabled the creation or manipulation of high-fidelity facial images and videos via deep generative approaches. This technology, also known as deepfake, has achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Lixia Ma , Puning Yang , Yuting Xu , Ziming Yang , Peipei Li , Huaibo Huang

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao

As generative artificial intelligence evolves, deepfake attacks have escalated from single-modality manipulations to complex, multimodal threats. Existing forensic techniques face a severe generalization bottleneck: by relying excessively…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jingtong Dou , Chuancheng Shi , Jian Wang , Fei Shen , Zhiyong Wang , Tat-Seng Chua

Generalizability to unseen forgery types is crucial for face forgery detectors. Recent works have made significant progress in terms of generalization by synthetic forgery data augmentation. In this work, we explore another path for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Jianwei Fei , Yunshu Dai , Huaming Wang , Zhihua Xia

While the Contrastive Language-Image Pretraining(CLIP) model has achieved remarkable success in a variety of downstream vison language understanding tasks, enhancing its capability for fine-grained image-text alignment remains an active…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Yicheng Xiao , Yu Chen , Haoxuan Ma , Jiale Hong , Caorui Li , Lingxiang Wu , Haiyun Guo , Jinqiao Wang

Deep generator technology can produce high-quality fake videos that are indistinguishable, posing a serious social threat. Traditional forgery detection methods directly centralized training on data and lacked consideration of information…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Decheng Liu , Zhan Dang , Chunlei Peng , Nannan Wang , Ruimin Hu , Xinbo Gao

Unified multimodal models (UMMs) have emerged as a powerful paradigm in fundamental cross-modality research, demonstrating significant potential in both image understanding and generation. However, existing research in the face domain…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Junzhe Li , Sifan Zhou , Liya Guo , Xuerui Qiu , Linrui Xu , Delin Qu , Tingting Long , Chun Fan , Ming Li , Hehe Fan , Jun Liu , Shuicheng Yan

The emergence of deepfake technology has introduced a range of societal problems, garnering considerable attention. Current deepfake detection methods perform well on specific datasets, but exhibit poor performance when applied to datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Lixin Jia , Zhiqing Guo , Gaobo Yang , Liejun Wang , Keqin Li

Fine-grained image retrieval (FGIR) is to learn visual representations that distinguish visually similar objects while maintaining generalization. Existing methods propose to generate discriminative features, but rarely consider the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xin Jiang , Hao Tang , Rui Yan , Jinhui Tang , Zechao Li

The rapid advancements in computer vision have stimulated remarkable progress in face forgery techniques, capturing the dedicated attention of researchers committed to detecting forgeries and precisely localizing manipulated areas.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Yingxin Lai , Zhiming Luo , Zitong Yu

This work focuses on AIGC detection to develop universal detectors capable of identifying various types of forgery images. Recent studies have found large pre-trained models, such as CLIP, are effective for generalizable deepfake detection…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Chuangchuang Tan , Renshuai Tao , Huan Liu , Guanghua Gu , Baoyuan Wu , Yao Zhao , Yunchao Wei

Face forgery techniques have emerged as a forefront concern, and numerous detection approaches have been proposed to address this challenge. However, existing methods predominantly concentrate on single-face manipulation detection, leaving…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Chenhao Lin , Fangbin Yi , Hang Wang , Qian Li , Deng Jingyi , Chao Shen

Artificial Intelligence-generated content has become increasingly popular, yet its malicious use, particularly the deepfakes, poses a serious threat to public trust and discourse. While deepfake detection methods achieve high predictive…

Machine Learning · Computer Science 2025-07-15 Tomasz Szandala , Fatima Ezzeddine , Natalia Rusin , Silvia Giordano , Omran Ayoub

Vision-Language Models (VLMs) like CLIP offer promising solutions for Dynamic Facial Expression Recognition (DFER) but face challenges such as inefficient full fine-tuning, high complexity, and poor alignment between textual and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ibtissam Saadi , Abdenour Hadid , Douglas W. Cunningham , Abdelmalik Taleb-Ahmed , Yassin El Hillali

The misuse of advanced generative AI models has resulted in the widespread proliferation of falsified data, particularly forged human-centric audiovisual content, which poses substantial societal risks (e.g., financial fraud and social…

Cryptography and Security · Computer Science 2025-10-28 Kangran Zhao , Yupeng Chen , Xiaoyu Zhang , Yize Chen , Weinan Guan , Baicheng Chen , Chengzhe Sun , Soumyya Kanti Datta , Qingshan Liu , Siwei Lyu , Baoyuan Wu

Deep learning models can encounter unexpected failures, especially when dealing with challenging sub-populations. One common reason for these failures is the occurrence of objects in backgrounds that are rarely seen during training. To gain…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Atoosa Chegini , Soheil Feizi

Weakly Supervised Semantic Segmentation (WSSS) with image-level labels typically leverages Class Activation Maps (CAMs) to achieve pixel-level predictions. Recently, Contrastive Language-Image Pre-training (CLIP) has been introduced to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Zhiwei Yang , Pengfei Song , Yucong Meng , Kexue Fu , Shuo Wang , Zhijian Song

Vision-language foundation models, represented by Contrastive Language-Image Pre-training (CLIP), have gained increasing attention for jointly understanding both vision and textual tasks. However, existing approaches primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bowen Shi , Peisen Zhao , Zichen Wang , Yuhang Zhang , Yaoming Wang , Jin Li , Wenrui Dai , Junni Zou , Hongkai Xiong , Qi Tian , Xiaopeng Zhang