English
Related papers

Related papers: A Survey on Speech Deepfake Detection

200 papers

The growing sophistication of speech generated by Artificial Intelligence (AI) has introduced new challenges in audio deepfake detection. Text-to-speech (TTS) and voice conversion (VC) technologies can create highly convincing synthetic…

Sound · Computer Science 2026-03-17 Vamshi Nallaguntla , Aishwarya Fursule , Shruti Kshirsagar , Anderson R. Avila

Recent research has highlighted a key issue in speech deepfake detection: models trained on one set of deepfakes perform poorly on others. The question arises: is this due to the continuously improving quality of Text-to-Speech (TTS)…

Sound · Computer Science 2024-06-13 Nicolas M. Müller , Nicholas Evans , Hemlata Tak , Philip Sperl , Konstantin Böttinger

The availability of highly convincing audio deepfake generators highlights the need for designing robust audio deepfake detectors. Existing works often rely solely on real and fake data available in the training set, which may lead to…

Sound · Computer Science 2024-07-11 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

Deepfakes, created using advanced AI techniques such as Variational Autoencoder and Generative Adversarial Networks, have evolved from research and entertainment applications into tools for malicious activities, posing significant threats…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Yamini Sri Krubha , Aryana Hou , Braden Vester , Web Walker , Xin Wang , Li Lin , Shu Hu

Self-supervised representations excel at many vision and speech tasks, but their potential for audio-visual deepfake detection remains underexplored. Unlike prior work that uses these features in isolation or buried within complex…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Dragos-Alexandru Boldisor , Stefan Smeu , Dan Oneata , Elisabeta Oneata

The proliferation of fake news on social media has opened up new directions of research for timely identification and containment of fake news, and mitigation of its widespread impact on public opinion. While much of the earlier research…

Machine Learning · Computer Science 2019-01-23 Karishma Sharma , Feng Qian , He Jiang , Natali Ruchansky , Ming Zhang , Yan Liu

Audio has become an increasingly crucial biometric modality due to its ability to provide an intuitive way for humans to interact with machines. It is currently being used for a range of applications, including person authentication to…

Sound · Computer Science 2023-07-14 Rishabh Ranjan , Mayank Vatsa , Richa Singh

We envision deepfake technologies, which synthesize realistic fake images and videos, will play an important role in the future metaverse. While enhancing users' immersion and experience with synthesized virtual characters and scenes,…

Human-Computer Interaction · Computer Science 2023-06-13 Haojie Wu , Pan Hui , Pengyuan Zhou

Deepfakes are synthetic content generated using advanced deep learning and AI technologies. The advancement of technology has created opportunities for anyone to create and share deepfakes much easier. This may lead to societal concerns…

Human-Computer Interaction · Computer Science 2022-03-30 Dilrukshi Gamage , Piyush Ghasiya , Vamshi Krishna Bonagiri , Mark E Whiting , Kazutoshi Sasahara

Audio DeepFakes allow the creation of high-quality, convincing utterances and therefore pose a threat due to its potential applications such as impersonation or fake news. Methods for detecting these manipulations should be characterized by…

Sound · Computer Science 2022-10-13 Piotr Kawa , Marcin Plata , Piotr Syga

The rapid surge of text-to-speech and face-voice reenactment models makes video fabrication easier and highly realistic. To encounter this problem, we require datasets that rich in type of generation methods and perturbation strategy which…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zhixi Cai , Kartik Kuckreja , Shreya Ghosh , Akanksha Chuchra , Muhammad Haris Khan , Usman Tariq , Tom Gedeon , Abhinav Dhall

The rapid advancement of deepfake technology has significantly elevated the realism and accessibility of synthetic media. Emerging techniques, such as diffusion-based models and Neural Radiance Fields (NeRF), alongside enhancements in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Md. Tarek Hasan , Sanjay Saha , Shaojing Fan , Swakkhar Shatabda , Terence Sim

Image manipulation is rapidly evolving, allowing the creation of credible content that can be used to bend reality. Although the results of deepfake detectors are promising, deepfakes can be made even more complicated to detect through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Davide Alessandro Coccomini , Roberto Caldelli , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

Recent advances in AI-generated voices have intensified the challenge of detecting deepfake audio, posing risks for scams and the spread of disinformation. To tackle this issue, we establish the largest public voice dataset to date, named…

This study addresses the critical challenge of detecting DeepFake tweets by leveraging advanced natural language processing (NLP) techniques to distinguish between genuine and AI-generated texts. Given the increasing prevalence of…

Computation and Language · Computer Science 2024-06-25 Adam Frej , Adrian Kaminski , Piotr Marciniak , Szymon Szmajdzinski , Soveatin Kuntur , Anna Wroblewska

Multimodal generative models are rapidly evolving, leading to a surge in the generation of realistic video and audio that offers exciting possibilities but also serious risks. Deepfake videos, which can convincingly impersonate individuals,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Hannah Lee , Changyeon Lee , Kevin Farhat , Lin Qiu , Steve Geluso , Aerin Kim , Oren Etzioni

Deepfakes are computationally-created entities that falsely represent reality. They can take image, video, and audio modalities, and pose a threat to many areas of systems and societies, comprising a topic of interest to various aspects of…

Human-Computer Interaction · Computer Science 2023-05-26 Sergi D. Bray , Shane D. Johnson , Bennett Kleinberg

Advancements in DeepFake (DF) audio models pose a significant threat to voice authentication systems, leading to unauthorized access and the spread of misinformation. We introduce a defense mechanism, SecureSpectra, addressing DF threats by…

Cryptography and Security · Computer Science 2024-10-07 Oguzhan Baser , Kaan Kale , Sandeep P. Chinchali

With a recent influx of voice generation methods, the threat introduced by audio DeepFake (DF) is ever-increasing. Several different detection methods have been presented as a countermeasure. Many methods are based on so-called front-ends,…

Sound · Computer Science 2023-06-05 Piotr Kawa , Marcin Plata , Michał Czuba , Piotr Szymański , Piotr Syga

Visual speech, referring to the visual domain of speech, has attracted increasing attention due to its wide applications, such as public security, medical treatment, military defense, and film entertainment. As a powerful AI strategy, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Changchong Sheng , Gangyao Kuang , Liang Bai , Chenping Hou , Yulan Guo , Xin Xu , Matti Pietikäinen , Li Liu