English
Related papers

Related papers: Where are we in audio deepfake detection? A system…

200 papers

The rapid advancement of generative models has enabled the creation of increasingly stealthy synthetic voices, commonly referred to as audio deepfakes. A recent technique, FOICE [USENIX'24], demonstrates a particularly alarming capability:…

Cryptography and Security · Computer Science 2025-11-14 Nguyen Linh Bao Nguyen , Alsharif Abuadbba , Kristen Moore , Tingmin Wu

Neural Text-to-speech (TTS) synthesis is a powerful technology that can generate speech using neural networks. One of the most remarkable features of TTS synthesis is its capability to produce speech in the voice of different speakers. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-19 Vinotha R , Hepsiba D , L. D. Vijay Anand , Deepak John Reji

Deepfake is a widely used technology employed in recent years to create pernicious content such as fake news, movies, and rumors by altering and substituting facial information from various sources. Given the ongoing evolution of deepfakes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruchika Sharma , Rudresh Dwivedi

Audio deepfakes pose a growing threat, already exploited in fraud and misinformation. A key challenge is ensuring detectors remain robust to unseen synthesis methods and diverse speakers, since generation techniques evolve quickly. Despite…

Sound · Computer Science 2025-10-28 Jiyoung Hong , Yoonseo Chung , Seungyeon Oh , Juntae Kim , Jiyoung Lee , Sookyung Kim , Hyunsoo Cho

This paper conducts a comprehensive layer-wise analysis of self-supervised learning (SSL) models for audio deepfake detection across diverse contexts, including multilingual datasets (English, Chinese, Spanish), partial, song, and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-10 Yassine El Kheir , Youness Samih , Suraj Maharjan , Tim Polzehl , Sebastian Möller

The state-of-art models for speech synthesis and voice conversion are capable of generating synthetic speech that is perceptually indistinguishable from bonafide human speech. These methods represent a threat to the automatic speaker…

Machine Learning · Computer Science 2019-07-11 Moustafa Alzantot , Ziqi Wang , Mani B. Srivastava

Recent advances in AI-generated voices have intensified the challenge of detecting deepfake audio, posing risks for scams and the spread of disinformation. To tackle this issue, we establish the largest public voice dataset to date, named…

The recent advancements in generative artificial speech models have made possible the generation of highly realistic speech signals. At first, it seems exciting to obtain these artificially synthesized signals such as speech clones or deep…

Sound · Computer Science 2022-03-09 Karan Bhatia , Ansh Agrawal , Priyanka Singh , Arun Kumar Singh

Large Language Models and commercial speech synthesis systems now enable highly realistic AI-generated voice scams (vishing), raising urgent concerns about deception at scale. Yet it remains unclear whether individuals can reliably…

Cryptography and Security · Computer Science 2026-03-27 Zoha Hayat Bhatti , Bakhtawar Ahtisham , Seemal Tausif , Niklas George , Nida ul Habib Bajwa , Mobin Javed

Artificial intelligence (AI) in media has advanced rapidly over the last decade. The introduction of Generative Adversarial Networks (GANs) improved the quality of photorealistic image generation. Diffusion models later brought a new era of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Redwan Hussain , Mizanur Rahman , Prithwiraj Bhattacharjee

This paper addresses the challenge of speaker separation, which remains an active research topic despite the promising results achieved in recent years. These results, however, often degrade in real recording conditions due to the presence…

Sound · Computer Science 2024-11-14 Rawad Melhem , Assef Jafar , Oumayma Al Dakkak

With the huge technological advances introduced by deep learning in audio & speech processing, many novel synthetic speech techniques achieved incredible realistic results. As these methods generate realistic fake human voices, they can be…

The task of deepfakes detection is far from being solved by speech or vision researchers. Several publicly available databases of fake synthetic video and speech were built to aid the development of detection methods. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Pavel Korshunov , Haolin Chen , Philip N. Garner , Sebastien Marcel

General audio source separation is a key capability for multimodal AI systems that can perceive and reason about sound. Despite substantial progress in recent years, existing separation models are either domain-specific, designed for fixed…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-24 Bowen Shi , Andros Tjandra , John Hoffman , Helin Wang , Yi-Chiao Wu , Luya Gao , Julius Richter , Matt Le , Apoorv Vyas , Sanyuan Chen , Christoph Feichtenhofer , Piotr Dollár , Wei-Ning Hsu , Ann Lee

The rapid advancement of voice generation technologies has enabled the synthesis of speech that is perceptually indistinguishable from genuine human voices. While these innovations facilitate beneficial applications such as personalized…

Cryptography and Security · Computer Science 2025-07-30 Aditya Pujari , Ajita Rattani

Logical Access (LA) attacks, also known as audio deepfake attacks, use Text-to-Speech (TTS) or Voice Conversion (VC) methods to generate spoofed speech data. This can represent a serious threat to Automatic Speaker Verification (ASV)…

Sound · Computer Science 2026-03-17 Anacin , Angela , Shruti Kshirsagar , Anderson R. Avila

Deepfake speech utterances can be forged by replacing one or more words in a bona fide utterance with semantically different words synthesized with speech-generative models. While a dedicated synthetic word detector could be developed, we…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-03 Hoan My Tran , Xin Wang , Wanying Ge , Xuechen Liu , Junichi Yamagishi

Deepfake audio detection has progressed rapidly with strong pre-trained encoders (e.g., WavLM, Wav2Vec2, MMS). However, performance in realistic capture conditions - background noise (domestic/office/transport), room reverberation, and…

Sound · Computer Science 2025-12-17 Udayon Sen , Alka Luqman , Anupam Chattopadhyay

Speech deepfake detection is a well-established research field with different models, datasets, and training strategies. However, the lack of standardized implementations and evaluation protocols limits reproducibility, benchmarking, and…

Recent advances in synthetic speech have made audio deepfakes increasingly realistic, posing significant security risks. Existing detection methods that rely on a single modality, either raw waveform embeddings or spectral based features,…