English
Related papers

Related papers: FakeSound2: A Benchmark for Explainable and Genera…

200 papers

The objective of this paper is speaker recognition under noisy and unconstrained conditions. We make two key contributions. First, we introduce a very large-scale audio-visual speaker recognition dataset collected from open-source media.…

Sound · Computer Science 2020-11-05 Joon Son Chung , Arsha Nagrani , Andrew Zisserman

The rapid advancement of voice generation technologies has enabled the synthesis of speech that is perceptually indistinguishable from genuine human voices. While these innovations facilitate beneficial applications such as personalized…

Cryptography and Security · Computer Science 2025-07-30 Aditya Pujari , Ajita Rattani

Recent advances in audio generation systems have enabled the creation of highly realistic and immersive soundscapes, which are increasingly used in film and virtual reality. However, these audio generators also raise concerns about…

Sound · Computer Science 2025-12-25 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Ting Dang

In this research study, we propose a modern artificial intelligence (AI) approach to recognize deepfake voice, also known as generative AI cloned synthetic voice. Our proposed AI technology, called AntiDeepFake, consists of all main…

Sound · Computer Science 2024-02-19 Enkhtogtokh Togootogtokh , Christian Klasen

Deepfake technologies are often associated with deception, misinformation, and identity fraud, raising legitimate societal concerns. Yet such narratives may obscure a key insight: deepfakes embody sophisticated capabilities for sensory…

Computers and Society · Computer Science 2025-10-28 Yizhi Liu , Balaji Padmanabhan , Siva Viswanathan

The effectiveness of deepfake detection methods often depends less on their core design and more on implementation details such as data preprocessing, augmentation strategies, and optimization techniques. These factors make it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Lorenzo Pellegrini , Serafino Pandolfini , Davide Maltoni , Matteo Ferrara , Marco Prati , Marco Ramilli

Audio has become an increasingly crucial biometric modality due to its ability to provide an intuitive way for humans to interact with machines. It is currently being used for a range of applications, including person authentication to…

Sound · Computer Science 2023-07-14 Rishabh Ranjan , Mayank Vatsa , Richa Singh

The proliferation of DeepFake technology is a rising challenge in today's society, owing to more powerful and accessible generation methods. To counter this, the research community has developed detectors of ever-increasing accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Federico Baldassarre , Quentin Debard , Gonzalo Fiz Pontiveros , Tri Kurniawan Wijaya

Conventional spoofing detection systems have heavily relied on the use of handcrafted features derived from speech data. However, a notable shift has recently emerged towards the direct utilization of raw speech waveforms, as demonstrated…

Deepfakes are increasingly realistic and easy to produce, raising concerns about the reliability of human judgments in misinformation settings. We study audiovisual deepfake detection by measuring how consistently crowd workers distinguish…

Information Retrieval · Computer Science 2026-05-07 Michael Soprano , Andrea Cioci , Stefano Mizzaro

Deepfake or synthetic images produced using deep generative models pose serious risks to online platforms. This has triggered several research efforts to accurately detect deepfake images, achieving excellent performance on publicly…

Cryptography and Security · Computer Science 2024-04-26 Sifat Muhammad Abdullah , Aravind Cheruvu , Shravya Kanchi , Taejoong Chung , Peng Gao , Murtuza Jadliwala , Bimal Viswanath

Speech deepfakes pose a significant threat to personal security and content authenticity. Several detectors have been proposed in the literature, and one of the primary challenges these systems have to face is the generalization over unseen…

Sound · Computer Science 2024-09-25 Viola Negroni , Davide Salvi , Alessandro Ilic Mezza , Paolo Bestagini , Stefano Tubaro

The increasing realism of synthetic speech, driven by advancements in text-to-speech models, raises ethical concerns regarding impersonation and disinformation. Audio watermarking offers a promising solution via embedding…

Machine Learning · Computer Science 2024-11-14 Hongbin Liu , Moyang Guo , Zhengyuan Jiang , Lun Wang , Neil Zhenqiang Gong

Fake audio attack becomes a major threat to the speaker verification system. Although current detection approaches have achieved promising results on dataset-specific scenarios, they encounter difficulties on unseen spoofing data.…

Sound · Computer Science 2022-07-12 Haoxin Ma , Jiangyan Yi , Jianhua Tao , Ye Bai , Zhengkun Tian , Chenglong Wang

The increasing use of synthetic media, particularly deepfakes, is an emerging challenge for digital content verification. Although recent studies use both audio and visual information, most integrate these cues within a single model, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Sayeem Been Zaman , Wasimul Karim , Arefin Ittesafun Abian , Reem E. Mohamed , Md Rafiqul Islam , Asif Karim , Sami Azam

Large Audio-Language Models (LALMs) have recently achieved strong performance across various audio-centric tasks. However, hallucination, where models generate responses that are semantically incorrect or acoustically unsupported, remains…

Sound · Computer Science 2026-04-22 Feiyu Zhao , Yiming Chen , Wenhuan Lu , Daipeng Zhang , Xianghu Yue , Jianguo Wei

Existing methods on audio-visual deepfake detection mainly focus on high-level features for modeling inconsistencies between audio and visual data. As a result, these approaches usually overlook finer audio-visual artifacts, which are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

The rapid advancement of speech synthesis and voice conversion technologies has raised significant security concerns in multimedia forensics. Although current detection models demonstrate impressive performance, they struggle to maintain…

Sound · Computer Science 2025-11-26 Wangjie Li , Lin Li , Qingyang Hong

Audio deepfake detection (ADD) models are commonly evaluated using datasets that combine multiple synthesizers, with performance reported as a single Equal Error Rate (EER). However, this approach disproportionately weights synthesizers…

Sound · Computer Science 2025-09-12 Chin Yuen Kwok , Jia Qi Yip , Zhen Qiu , Chi Hung Chi , Kwok Yan Lam

Speech deepfakes are artificial voices generated by machine learning models. Previous literature has highlighted deepfakes as one of the biggest security threats arising from progress in artificial intelligence due to their potential for…

Human-Computer Interaction · Computer Science 2023-08-04 Kimberly T. Mai , Sergi D. Bray , Toby Davies , Lewis D. Griffin