English
Related papers

Related papers: Self-supervised Transformer for Deepfake Detection

200 papers

Face anti-spoofing is critical to the security of face recognition systems. Depth supervised learning has been proven as one of the most effective methods for face anti-spoofing. Despite the great success, most previous works still…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Zezheng Wang , Zitong Yu , Chenxu Zhao , Xiangyu Zhu , Yunxiao Qin , Qiusheng Zhou , Feng Zhou , Zhen Lei

Modern natural language processing (NLP) methods employ self-supervised pretraining objectives such as masked language modeling to boost the performance of various application tasks. These pretraining methods are frequently extended with…

Computation and Language · Computer Science 2021-02-26 Nils Rethmeier , Isabelle Augenstein

In this paper, we study the problem of generalizable synthetic image detection, aiming to detect forgery images from diverse generative methods, e.g., GANs and diffusion models. Cutting-edge solutions start to explore the benefits of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Huan Liu , Zichang Tan , Chuangchuang Tan , Yunchao Wei , Yao Zhao , Jingdong Wang

Face anti-spoofing (FAS) heavily relies on identifying live/spoof discriminative features to counter face presentation attacks. Recently, we proposed LDCformer to successfully incorporate the Learnable Descriptive Convolution (LDC) into…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Pei-Kai Huanga , Jun-Xiong Chong , Ming-Tsung Hsu , Fang-Yu Hsu , Chiou-Ting Hsu

The tremendous success of deep learning for imaging applications has resulted in numerous beneficial advances. Unfortunately, this success has also been a catalyst for malicious uses such as photo-realistic face swapping of parties without…

Machine Learning · Computer Science 2019-09-11 Xinyi Ding , Zohreh Raziei , Eric C. Larson , Eli V. Olinick , Paul Krueger , Michael Hahsler

Recently, Deepfake has drawn considerable public attention due to security and privacy concerns in social media digital forensics. As the wildly spreading Deepfake videos on the Internet become more realistic, traditional detection…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Tianyi Wang , Harry Cheng , Kam Pui Chow , Liqiang Nie

This paper presents a novel method for face clustering in videos using a video-centralised transformer. Previous works often employed contrastive learning to learn frame-level representation and used average pooling to aggregate the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Yujiang Wang , Mingzhi Dong , Jie Shen , Yiming Luo , Yiming Lin , Pingchuan Ma , Stavros Petridis , Maja Pantic

Despite the recent success of deep learning in the field of medicine, the issue of data scarcity is exacerbated by concerns about privacy and data ownership. Distributed learning approaches, including federated learning, have been…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Sangjoon Park , Ik-Jae Lee , Jun Won Kim , Jong Chul Ye

Deep neural networks need a big amount of training data, while in the real world there is a scarcity of data available for training purposes. To resolve this issue unsupervised methods are used for training with limited data. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Sayed Hashim , Muhammad Ali

This paper tackles the challenge of detecting partially manipulated facial deepfakes, which involve subtle alterations to specific facial features while retaining the overall context, posing a greater detection difficulty than fully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Andrii Yermakov , Jan Cech , Jiri Matas

In this work, we attempted to unleash the potential of self-supervised learning as an auxiliary task that can optimise the primary task of generalised deepfake detection. To explore this, we examined different combinations of the training…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Shukesh Reddy , Srijan Das , Abhijit Das

Recently, self-supervised vision transformers have attracted unprecedented attention for their impressive representation learning ability. However, the dominant method, contrastive learning, mainly relies on an instance discrimination…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Luya Wang , Feng Liang , Yangguang Li , Honggang Zhang , Wanli Ouyang , Jing Shao

Analyzing the story behind TV series and movies often requires understanding who the characters are and what they are doing. With improving deep face models, this may seem like a solved problem. However, as face detectors get better,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Vivek Sharma , Makarand Tapaswi , M. Saquib Sarfraz , Rainer Stiefelhagen

A major challenge in DeepFake forgery detection is that state-of-the-art algorithms are mostly trained to detect a specific fake method. As a result, these approaches show poor generalization across different types of facial manipulations,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Davide Cozzolino , Andreas Rössler , Justus Thies , Matthias Nießner , Luisa Verdoliva

Deepfake detection refers to detecting artificially generated or edited faces in images or videos, which plays an essential role in visual information security. Despite promising progress in recent years, Deepfake detection remains a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Chunlei Peng , Huiqing Guo , Decheng Liu , Nannan Wang , Ruimin Hu , Xinbo Gao

In this work, we propose a novel methodology for self-supervised learning for generating global and local attention-aware visual features. Our approach is based on training a model to differentiate between specific image transformations of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Trung X. Pham , Rusty John Lloyd Mina , Dias Issa , Chang D. Yoo

Deepfakes are AI-generated media in which the original content is digitally altered to create convincing but manipulated images, videos, or audio. Among the various types of deepfakes, lip-syncing deepfakes are one of the most challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Soumyya Kanti Datta , Shan Jia , Siwei Lyu

In this work, we investigate several methods and strategies to learn deep embeddings for face recognition, using joint sample- and set-based optimization. We explain our framework that expands traditional learning with set-based supervision…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Baris Gecer , Vassileios Balntas , Tae-Kyun Kim

Face anti-spoofing has drawn a lot of attention due to the high security requirements in biometric authentication systems. Bringing face biometric to commercial hardware became mostly dependent on developing reliable methods for detecting…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Nikolay Sergievskiy , Roman Vlasov , Roman Trusov

Deepfake represents a category of face-swapping attacks that leverage machine learning models such as autoencoders or generative adversarial networks. Although the concept of the face-swapping is not new, its recent technical advances make…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Chaofei Yang , Lei Ding , Yiran Chen , Hai Li