English
Related papers

Related papers: Waveform Boundary Detection for Partially Spoofed …

200 papers

This perspective calls for scholars across disciplines to address the challenge of audio deepfake detection and discernment through an interdisciplinary lens across Artificial Intelligence methods and linguistics. With an avalanche of tools…

Sound · Computer Science 2024-11-12 Vandana P. Janeja , Christine Mallinson

This paper proposes an audio-visual deepfake detection approach that aims to capture fine-grained temporal inconsistencies between audio and visual modalities. To achieve this, both architectural and data synthesis strategies are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

In this paper, we propose an effective sound event detection (SED) method based on the audio spectrogram transformer (AST) model, pretrained on the large-scale AudioSet for audio tagging (AT) task, termed AST-SED. Pretrained AST models have…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Kang Li , Yan Song , Li-Rong Dai , Ian McLoughlin , Xin Fang , Lin Liu

Self-supervised speech model is a rapid progressing research topic, and many pre-trained models have been released and used in various down stream tasks. For speech anti-spoofing, most countermeasures (CMs) use signal processing algorithms…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-07 Xin Wang , Junichi Yamagishi

Automatic speaker verification (ASV) systems utilize the biometric information in human speech to verify the speaker's identity. The techniques used for performing speaker verification are often vulnerable to malicious attacks that attempt…

Sound · Computer Science 2020-11-26 Yang Gao , Jiachen Lian , Bhiksha Raj , Rita Singh

Most deepfake detection methods focus on detecting spatial and/or spatio-temporal changes in facial attributes and are centered around the binary classification task of detecting whether a video is real or fake. This is because available…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhixi Cai , Shreya Ghosh , Abhinav Dhall , Tom Gedeon , Kalin Stefanov , Munawar Hayat

Recent advancements in generative AI, particularly in speech synthesis, have enabled the generation of highly natural-sounding synthetic speech that closely mimics human voices. While these innovations hold promise for applications like…

In the contemporary digital age, the proliferation of deepfakes presents a formidable challenge to the sanctity of information dissemination. Audio deepfakes, in particular, can be deceptively realistic, posing significant risks in…

Sound · Computer Science 2024-02-28 Karthik Sivarama Krishnan , Koushik Sivarama Krishnan

Deepfakes have become a universal and rapidly intensifying concern of generative AI across various media types such as images, audio, and videos. Among these, audio deepfakes have been of particular concern due to the ease of high-quality…

Cryptography and Security · Computer Science 2025-03-25 Xiang Li , Pin-Yu Chen , Wenqi Wei

Deepfake (DF) attacks pose a growing threat as generative models become increasingly advanced. However, our study reveals that existing DF datasets fail to deceive human perception, unlike real DF attacks that influence public discourse. It…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Oguzhan Baser , Ahmet Ege Tanriverdi , Sriram Vishwanath , Sandeep P. Chinchali

Audio temporal forgery localization (ATFL) aims to find the precise forgery regions of the partial spoof audio that is purposefully modified. Existing ATFL methods rely on training efficient networks using fine-grained annotations, which…

Sound · Computer Science 2025-05-08 Junyan Wu , Wenbo Xu , Wei Lu , Xiangyang Luo , Rui Yang , Shize Guo

Deep learning has enabled highly realistic synthetic speech, raising concerns about fraud, impersonation, and disinformation. Despite rapid progress in neural detectors, transparent baselines are needed to reveal which acoustic cues…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-16 Faheem Ahmad , Ajan Ahmed , Masudul Imtiaz

Due to the rapid progress of speech synthesis, deepfake detection has become a major concern in the speech processing community. Because it is a critical task, systems must not only be efficient and robust, but also provide interpretable…

Sound · Computer Science 2025-10-08 Antoine Teissier , Marie Tahon , Nicolas Dugué , Aghilas Sini

Deepfakes are synthetic media generated using deep generative algorithms and have posed a severe societal and political threat. Apart from facial manipulation and synthetic voice, recently, a novel kind of deepfakes has emerged with either…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Vinaya Sree Katamneni , Ajita Rattani

This paper describes our DKU replay detection system for the ASVspoof 2019 challenge. The goal is to develop spoofing countermeasure for automatic speaker recognition in physical access scenario. We leverage the countermeasure system…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-08 Weicheng Cai , Haiwei Wu , Danwei Cai , Ming Li

In this paper, Whisper, a large-scale pre-trained model for automatic speech recognition, is proposed to apply to speaker verification. A partial multi-scale feature aggregation (PMFA) approach is proposed based on a subset of Whisper…

Sound · Computer Science 2024-08-29 Yiyang Zhao , Shuai Wang , Guangzhi Sun , Zehua Chen , Chao Zhang , Mingxing Xu , Thomas Fang Zheng

An attacker may use a variety of techniques to fool an automatic speaker verification system into accepting them as a genuine user. Anti-spoofing methods meanwhile aim to make the system robust against such attacks. The ASVspoof 2017…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-01 Cheng-I Lai , Alberto Abad , Korin Richmond , Junichi Yamagishi , Najim Dehak , Simon King

In this paper, we present our submitted XMUspeech systems to the speech deepfake detection track of the ASVspoof 5 Challenge. Compared to previous challenges, the audio duration in ASVspoof 5 database has significantly increased. And we…

Sound · Computer Science 2025-09-24 Wangjie Li , Xingjia Xie , Yishuang Li , Wenhao Guan , Kaidi Wang , Pengyu Ren , Lin Li , Qingyang Hong

Audio DeepFakes (DF) are artificially generated utterances created using deep learning, with the primary aim of fooling the listeners in a highly convincing manner. Their quality is sufficient to pose a severe threat in terms of security…

Sound · Computer Science 2023-06-13 Piotr Kawa , Marcin Plata , Piotr Syga

With the advancement of generative modeling techniques, synthetic human speech becomes increasingly indistinguishable from real, and tricky challenges are elicited for the audio deepfake detection (ADD) system. In this paper, we exploit…

Sound · Computer Science 2024-03-05 Yujie Yang , Haochen Qin , Hang Zhou , Chengcheng Wang , Tianyu Guo , Kai Han , Yunhe Wang