English
Related papers

Related papers: Exposing Lip-syncing Deepfakes from Mouth Inconsis…

200 papers

Speech deepfakes are artificial voices generated by machine learning models. Previous literature has highlighted deepfakes as one of the biggest security threats arising from progress in artificial intelligence due to their potential for…

Human-Computer Interaction · Computer Science 2023-08-04 Kimberly T. Mai , Sergi D. Bray , Toby Davies , Lewis D. Griffin

DeepFake based digital facial forgery is threatening public media security, especially when lip manipulation has been used in talking face generation, and the difficulty of fake video detection is further improved. By only changing lip…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Ganglai Wang , Peng Zhang , Junwen Xiong , Feihan Yang , Wei Huang , Yufei Zha

We propose a method for detecting face swapping and other identity manipulations in single images. Face swapping methods, such as DeepFake, manipulate the face region, aiming to adjust the face to the appearance of its context, while…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Yuval Nirkin , Lior Wolf , Yosi Keller , Tal Hassner

Video editing-based talking face generation aims to preserve video details such as pose, lighting, and gestures while modifying only lip motion, often using an identity reference image to maintain speaker consistency. However, this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Dogucan Yaman , Fevziye Irem Eyiokur , Hazım Kemal Ekenel , Alexander Waibel

Generalizing deepfake detection to unseen manipulations remains a key challenge. A recent approach to tackle this issue is to train a network with pristine face images that have been manipulated with hand-crafted artifacts to extract more…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Alejandro Cobo , Roberto Valle , José Miguel Buenaposada , Luis Baumela

Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions, which has significant application potential in fields such as entertainment, movie production, digital human creation, to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Gan Pei , Jiangning Zhang , Menghan Hu , Zhenyu Zhang , Chengjie Wang , Yunsheng Wu , Guangtao Zhai , Jian Yang , Dacheng Tao

While the significant advancements have made in the generation of deepfakes using deep learning technologies, its misuse is a well-known issue now. Deepfakes can cause severe security and privacy issues as they can be used to impersonate a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Hasam Khalid , Shahroz Tariq , Minha Kim , Simon S. Woo

The rapid development of facial manipulation techniques has aroused public concerns in recent years. Following the success of deep learning, existing methods always formulate DeepFake video detection as a binary classification problem and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Zhihao Gu , Yang Chen , Taiping Yao , Shouhong Ding , Jilin Li , Feiyue Huang , Lizhuang Ma

The challenge of talking face generation from speech lies in aligning two different modal information, audio and video, such that the mouth region corresponds to input audio. Previous methods either exploit audio-visual representation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Se Jin Park , Minsu Kim , Joanna Hong , Jeongsoo Choi , Yong Man Ro

Deepfake technology has rapidly advanced and poses significant threats to information integrity and trust in online multimedia. While significant progress has been made in detecting deepfakes, the simultaneous manipulation of audio and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Christos Koutlis , Symeon Papadopoulos

Deepfake represents a category of face-swapping attacks that leverage machine learning models such as autoencoders or generative adversarial networks. Although the concept of the face-swapping is not new, its recent technical advances make…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Chaofei Yang , Lei Ding , Yiran Chen , Hai Li

With the advancement of deepfake generation techniques, the importance of deepfake detection in protecting multimedia content integrity has become increasingly obvious. Recently, temporal inconsistency clues have been explored to improve…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Fan Nie , Jiangqun Ni , Jian Zhang , Bin Zhang , Weizhe Zhang

In this paper, we introduce MINTIME, a video deepfake detection approach that captures spatial and temporal anomalies and handles instances of multiple people in the same video and variations in face sizes. Previous approaches disregard…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Davide Alessandro Coccomini , Giorgos Kordopatis Zilos , Giuseppe Amato , Roberto Caldelli , Fabrizio Falchi , Symeon Papadopoulos , Claudio Gennaro

With rapid advancements in generative modeling, deepfake techniques are increasingly narrowing the gap between real and synthetic videos, raising serious privacy and security concerns. Beyond traditional face swapping and reenactment, an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tharun Anand , Siva Sankar Sajeev , Pravin Nair

It is becoming increasingly easy to automatically replace a face of one person in a video with the face of another person by using a pre-trained generative adversarial network (GAN). Recent public scandals, e.g., the faces of celebrities…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Pavel Korshunov , Sebastien Marcel

Multimodal generative models are rapidly evolving, leading to a surge in the generation of realistic video and audio that offers exciting possibilities but also serious risks. Deepfake videos, which can convincingly impersonate individuals,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Hannah Lee , Changyeon Lee , Kevin Farhat , Lin Qiu , Steve Geluso , Aerin Kim , Oren Etzioni

Deepfake techniques have been widely used for malicious purposes, prompting extensive research interest in developing Deepfake detection methods. Deepfake manipulations typically involve tampering with facial parts, which can result in…

Multimedia · Computer Science 2023-05-11 Juan Hu , Xin Liao , Difei Gao , Satoshi Tsutsui , Qian Wang , Zheng Qin , Mike Zheng Shou

Deepfake techniques have been widely used for malicious purposes, prompting extensive research interest in developing Deepfake detection methods. Deepfake manipulations typically involve tampering with facial parts, which can result in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Juan Hu , Xin Liao , Difei Gao , Satoshi Tsutsui , Qian Wang , Zheng Qin , Mike Zheng Shou

Recent advancements in deep learning generative models have raised concerns as they can create highly convincing counterfeit images and videos. This poses a threat to people's integrity and can lead to social instability. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Leandro A. Passos , Danilo Jodas , Kelton A. P. da Costa , Luis A. Souza Júnior , Douglas Rodrigues , Javier Del Ser , David Camacho , João Paulo Papa

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person's expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Peter Grönquist , Yufan Ren , Qingyi He , Alessio Verardo , Sabine Süsstrunk