English
Related papers

Related papers: Listening Deepfake Detection: A New Perspective Be…

200 papers

In this paper, we propose a deep-learning framework for environmental sound deepfake detection (ESDD) -- the task of identifying whether the sound scene and sound event in an input audio recording is fake or not. To this end, we conducted…

Sound · Computer Science 2026-05-04 Lam Pham , Khoi Vu , Dat Tran , Phat Lam , Vu Nguyen , David Fischinger , Son Le

Deep learning has enabled realistic face manipulation (i.e., deepfake), which poses significant concerns over the integrity of the media in circulation. Most existing deep learning techniques for deepfake detection can achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Bosheng Yan , Chang-Tsun Li , Xuequan Lu

Detecting partial deepfake speech is challenging because manipulations occur only in short regions while the surrounding audio remains authentic. However, existing detection methods are fundamentally limited by the quality of available…

Sound · Computer Science 2025-12-16 Menglu Li , Majd Alber , Ramtin Asgarianamiri , Lian Zhao , Xiao-Ping Zhang

Deepfake detection remains highly challenging, particularly in cross-dataset scenarios and complex real-world settings. This challenge mainly arises because artifact patterns vary substantially across different forgery methods, whereas…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiang Zhang , Wenliang Weng , Daoyong Fu , Beijing Chen , Ziqiang Li , Ziwen He , Zhangjie Fu

With the continuous development of deep learning-based speech conversion and speech synthesis technologies, the cybersecurity problem posed by fake audio has become increasingly serious. Previously proposed models for defending against fake…

Sound · Computer Science 2025-06-04 Chi Ding , Junxiao Xue , Cong Wang , Hao Zhou

Deepfakes are synthetically generated media often devised with malicious intent. They have become increasingly more convincing with large training datasets advanced neural networks. These fakes are readily being misused for slander,…

Cryptography and Security · Computer Science 2022-03-30 Nicolas M. Müller , Franziska Dieckmann , Jennifer Williams

Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions, which has significant application potential in fields such as entertainment, movie production, digital human creation, to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Gan Pei , Jiangning Zhang , Menghan Hu , Zhenyu Zhang , Chengjie Wang , Yunsheng Wu , Guangtao Zhai , Jian Yang , Dacheng Tao

Deepfake speech utterances can be forged by replacing one or more words in a bona fide utterance with semantically different words synthesized with speech-generative models. While a dedicated synthetic word detector could be developed, we…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-03 Hoan My Tran , Xin Wang , Wanying Ge , Xuechen Liu , Junichi Yamagishi

We present work on deception detection, where, given a spoken claim, we aim to predict its factuality. While previous work in the speech community has relied on recordings from staged setups where people were asked to tell the truth or to…

Computation and Language · Computer Science 2019-10-07 Daniel Kopev , Ahmed Ali , Ivan Koychev , Preslav Nakov

The accelerated growth in synthetic visual media generation and manipulation has now reached the point of raising significant concerns and posing enormous intimidations towards society. There is an imperative need for automatic detection…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Ying Xu , Sule Yildirim Yayilgan

Voice authentication systems deployed at the network edge face dual threats: a) sophisticated deepfake synthesis attacks and b) control-plane poisoning in distributed federated learning protocols. We present a framework coupling…

Sound · Computer Science 2025-12-09 Alireza Mohammadi , Keshav Sood , Dhananjay Thiruvady , Asef Nazari

The emergence of text-to-image generative models has revolutionized the field of deepfakes, enabling the creation of realistic and convincing visual content directly from textual descriptions. However, this advancement presents considerably…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Yabin Wang , Zhiwu Huang , Zhiheng Ma , Xiaopeng Hong

Deepfakes are AI-generated media in which the original content is digitally altered to create convincing but manipulated images, videos, or audio. Among the various types of deepfakes, lip-syncing deepfakes are one of the most challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Soumyya Kanti Datta , Shan Jia , Siwei Lyu

Highly realistic AI generated face forgeries known as deepfakes have raised serious social concerns. Although DNN-based face forgery detection models have achieved good performance, they are vulnerable to latest generative methods that have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yang Li , Songlin Yang , Wei Wang , Ziwen He , Bo Peng , Jing Dong

Achieving robust generalization in speech deepfake detection (SDD) remains a primary challenge, as models often fail to detect unseen forgery methods. While research has focused on model-centric and algorithm-centric solutions, the impact…

Sound · Computer Science 2025-12-30 Wen Huang , Yuchen Mao , Yanmin Qian

Multimodal deepfakes can exhibit subtle visual artifacts and cross-modal inconsistencies, which remain challenging to detect, especially when detectors are trained primarily on curated synthetic forgeries. Such synthetic dependence can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Sahibzada Adil Shahzad , Ammarah Hashmi , Junichi Yamagishi , Yusuke Yasuda , Yu Tsao , Chia-Wen Lin , Yan-Tsung Peng , Hsin-Min Wang

Deepfake speech detection presents a growing challenge as generative audio technologies continue to advance. We propose a hybrid training framework that advances detection performance through novel augmentation strategies. First, we…

Sound · Computer Science 2025-11-14 Inbal Rimon , Oren Gal , Haim Permuter

Advanced manipulation techniques have provided criminals with opportunities to make social panic or gain illicit profits through the generation of deceptive media, such as forged face images. In response, various deepfake detection methods…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Ruiyang Xia , Decheng Liu , Jie Li , Lin Yuan , Nannan Wang , Xinbo Gao

Parallel to the development of advanced deepfake audio generation, audio deepfake detection has also seen significant progress. However, a standardized and comprehensive benchmark is still missing. To address this, we introduce Speech…

The detection and localization of highly realistic deepfake audio-visual content are challenging even for the most advanced state-of-the-art methods. While most of the research efforts in this domain are focused on detecting high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhixi Cai , Shreya Ghosh , Aman Pankaj Adatia , Munawar Hayat , Abhinav Dhall , Tom Gedeon , Kalin Stefanov