English
Related papers

Related papers: PIA: Deepfake Detection Using Phoneme-Temporal and…

200 papers

We introduce a deepfake video detection approach that exploits pixel-wise temporal inconsistencies, which traditional spatial frequency-based detectors often overlook. Traditional detectors represent temporal information merely by stacking…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Taehoon Kim , Jongwook Choi , Yonghyun Jeong , Haeun Noh , Jaejun Yoo , Seungryul Baek , Jongwon Choi

Generative AI advances rapidly, allowing the creation of very realistic manipulated video and audio. This progress presents a significant security and ethical threat, as malicious users can exploit DeepFake techniques to spread…

Multimedia · Computer Science 2025-06-09 Marcel Klemt , Carlotta Segna , Anna Rohrbach

Due to the widespread use of smartphones with high-quality digital cameras and easy access to a wide range of software apps for recording, editing, and sharing videos and images, as well as the deep learning AI platforms, a new phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Nikhil Sontakke , Sejal Utekar , Shivansh Rastogi , Shriraj Sonawane

Speech-driven 3D facial animation has garnered lots of attention thanks to its broad range of applications. Despite recent advancements in achieving realistic lip motion, current methods fail to capture the nuanced emotional undertones…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jisoo Kim , Jungbin Cho , Joonho Park , Soonmin Hwang , Da Eun Kim , Geon Kim , Youngjae Yu

DeepFake based digital facial forgery is threatening public media security, especially when lip manipulation has been used in talking face generation, and the difficulty of fake video detection is further improved. By only changing lip…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Ganglai Wang , Peng Zhang , Junwen Xiong , Feihan Yang , Wei Huang , Yufei Zha

Although current deep learning-based face forgery detectors achieve impressive performance in constrained scenarios, they are vulnerable to samples created by unseen manipulation methods. Some recent works show improvements in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Alexandros Haliassos , Konstantinos Vougioukas , Stavros Petridis , Maja Pantic

The misuse of deepfake technology by malicious actors poses a potential threat to nations, societies, and individuals. However, existing methods for detecting deepfakes primarily focus on uncompressed videos, such as noise characteristics,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Zongmei Chen , Xin Liao , Xiaoshuai Wu , Yanxiang Chen

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person's expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Peter Grönquist , Yufan Ren , Qingyi He , Alessio Verardo , Sabine Süsstrunk

With the rapid development of deep learning techniques, the generation and counterfeiting of multimedia material are becoming increasingly straightforward to perform. At the same time, sharing fake content on the web has become so simple…

Multimedia · Computer Science 2022-09-19 Davide Salvi , Brian Hosler , Paolo Bestagini , Matthew C. Stamm , Stefano Tubaro

The rapid emergence of multimodal deepfakes (visual and auditory content are manipulated in concert) undermines the reliability of existing detectors that rely solely on modality-specific artifacts or cross-modal inconsistencies. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yuxuan Du , Zhendong Wang , Yuhao Luo , Caiyong Piao , Zhiyuan Yan , Hao Li , Li Yuan

In this paper, we introduce MINTIME, a video deepfake detection approach that captures spatial and temporal anomalies and handles instances of multiple people in the same video and variations in face sizes. Previous approaches disregard…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Davide Alessandro Coccomini , Giorgos Kordopatis Zilos , Giuseppe Amato , Roberto Caldelli , Fabrizio Falchi , Symeon Papadopoulos , Claudio Gennaro

Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions, which has significant application potential in fields such as entertainment, movie production, digital human creation, to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Gan Pei , Jiangning Zhang , Menghan Hu , Zhenyu Zhang , Chengjie Wang , Yunsheng Wu , Guangtao Zhai , Jian Yang , Dacheng Tao

Online media data, in the forms of images and videos, are becoming mainstream communication channels. However, recent advances in deep learning, particularly deep generative models, open the doors for producing perceptually convincing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Junke Wang , Zhenxin Li , Chao Zhang , Jingjing Chen , Zuxuan Wu , Larry S. Davis , Yu-Gang Jiang

Deepfakes generated by advanced generative models have rapidly posed serious threats, yet existing audiovisual deepfake detection approaches struggle to generalize to unseen manipulation methods. To address this, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Hyemin Boo , Eunsang Lee , Jiyoung Lee

With the rapid advancement of sophisticated synthetic audio-visual content, e.g., for subtle malicious manipulations, ensuring the integrity of digital media has become paramount. This work presents a novel approach to temporal localization…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Christos Koutlis , Symeon Papadopoulos

We propose an end-to-end pipeline for both building and tracking 3D facial models from personalized in-the-wild (cellphone, webcam, youtube clips, etc.) video data. First, we present a method for automatic data curation and retrieval based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Winnie Lin , Yilin Zhu , Demi Guo , Ron Fedkiw

Audio-driven talking face generation, which aims to synthesize talking faces with realistic facial animations (including accurate lip movements, vivid facial expression details and natural head poses) corresponding to the audio, has…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Rongliang Wu , Yingchen Yu , Fangneng Zhan , Jiahui Zhang , Xiaoqin Zhang , Shijian Lu

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

Deepfake attacks, malicious manipulation of media containing people, are a serious concern for society. Conventional deepfake detection methods train supervised classifiers to distinguish real media from previously encountered deepfakes.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Tal Reiss , Bar Cavia , Yedid Hoshen

The rise of AI-driven generative models has enabled the creation of highly realistic speech deepfakes - synthetic audio signals that can imitate target speakers' voices - raising critical security concerns. Existing methods for detecting…

Sound · Computer Science 2025-03-25 Emma Coletta , Davide Salvi , Viola Negroni , Daniele Ugo Leonzio , Paolo Bestagini