中文
相关论文

相关论文: VoiceWukong: Benchmarking Deepfake Voice Detection

200 篇论文

With the proliferation of Large Language Model (LLM) based deepfake audio, there is an urgent need for effective detection methods. Previous deepfake audio generation methods typically involve a multi-step generation process, with the final…

Audio generation systems now create very realistic soundscapes that can enhance media production, but also pose potential risks. Several studies have examined deepfakes in speech or singing voice. However, environmental sounds have…

声音 · 计算机科学 2025-09-30 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Haohe Liu , Wenwu Wang , Mark D Plumbley

The objective of this paper is speaker recognition under noisy and unconstrained conditions. We make two key contributions. First, we introduce a very large-scale audio-visual speaker recognition dataset collected from open-source media.…

声音 · 计算机科学 2020-11-05 Joon Son Chung , Arsha Nagrani , Andrew Zisserman

Approximately 1.2% of the world's population has impaired voice production. As a result, automatic dysphonic voice detection has attracted considerable academic and clinical interest. However, existing methods for automated voice assessment…

声音 · 计算机科学 2023-01-27 Jianwei Zhang , Julie Liss , Suren Jayasuriya , Visar Berisha

The misuse of advanced generative AI models has resulted in the widespread proliferation of falsified data, particularly forged human-centric audiovisual content, which poses substantial societal risks (e.g., financial fraud and social…

Deepfake speech represents a real and growing threat to systems and society. Many detectors have been created to aid in defense against speech deepfakes. While these detectors implement myriad methodologies, many rely on low-level fragments…

Parallel to the development of advanced deepfake audio generation, audio deepfake detection has also seen significant progress. However, a standardized and comprehensive benchmark is still missing. To address this, we introduce Speech…

Voice AI agents are rapidly transitioning to production deployments, yet systematic methods for ensuring testing reliability remain underdeveloped. Organizations cannot objectively assess whether their testing approaches (internal tools or…

人工智能 · 计算机科学 2026-01-15 Miguel E. Andres , Vadim Fedorov , Rida Sadek , Enric Spagnolo-Arrizabalaga , Nadescha Trudel

Detecting partial deepfake speech is challenging because manipulations occur only in short regions while the surrounding audio remains authentic. However, existing detection methods are fundamentally limited by the quality of available…

声音 · 计算机科学 2025-12-16 Menglu Li , Majd Alber , Ramtin Asgarianamiri , Lian Zhao , Xiao-Ping Zhang

Thanks to recent advances in deep learning, sophisticated generation tools exist, nowadays, that produce extremely realistic synthetic speech. However, malicious uses of such tools are possible and likely, posing a serious threat to our…

声音 · 计算机科学 2022-09-29 Alessandro Pianese , Davide Cozzolino , Giovanni Poggi , Luisa Verdoliva

With the rapid advancement of Multi-modal Large Language Models (MLLMs), several diagnostic benchmarks have recently been developed to assess these models' multi-modal reasoning proficiency. However, these benchmarks are restricted to…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Sanjoy Chowdhury , Sayan Nag , Subhrajyoti Dasgupta , Yaoting Wang , Mohamed Elhoseiny , Ruohan Gao , Dinesh Manocha

In the area of Internet of Things (IoT) voice assistants have become an important interface to operate smart speakers, smartphones, and even automobiles. To save power and protect user privacy, voice assistants send commands to the cloud…

机器学习 · 计算机科学 2021-09-22 Yanjiao Chen , Yijie Bai , Richard Mitev , Kaibo Wang , Ahmad-Reza Sadeghi , Wenyuan Xu

Audio deepfake is so sophisticated that the lack of effective detection methods is fatal. While most detection systems primarily rely on low-level acoustic features or pretrained speech representations, they frequently neglect high-level…

声音 · 计算机科学 2025-09-16 Xiaokang Li , Yicheng Gong , Dinghao Zou , Xin Cao , Sunbowen Lee

As deepfake audio becomes more realistic and diverse, developing generalizable countermeasure systems has become crucial. Existing detection methods primarily depend on XLS-R front-end features to improve generalization. Nonetheless, their…

声音 · 计算机科学 2026-02-17 Zhe Ye , Xiangui Kang , Jiayi He , Chengxin Chen , Wei Zhu , Kai Wu , Yin Yang , Jiwu Huang

Large Audio-Language Models (LALMs) typically struggle with localized dialectal prosody due to the scarcity of specialized corpora. We present TW-Sound580K, a Taiwanese audio-text instruction dataset developed through a…

声音 · 计算机科学 2026-05-14 Hao-Hui Xie , Ho-Lam Chung , Yi-Cheng Lin , Ke-Han Lu , Wenze Ren , Xie Chen , Hung-yi Lee

The deepfake generation of singing vocals is a concerning issue for artists in the music industry. In this work, we propose a singing voice deepfake detection (SVDD) system, which uses noise-variant encodings of open-AI's Whisper model. As…

声音 · 计算机科学 2025-02-03 Falguni Sharma , Priyanka Gupta

RADAR Challenge 2026 is an APSIPA Grand Challenge on Robust Audio Deepfake Recognition under Media Transformations, designed to simulate realistic media conditions in real-world audio distribution pipelines, including compression,…

音频与语音处理 · 电气工程与系统科学 2026-05-26 Hieu-Thi Luong , Xuechen Liu , Ivan Kukanov , Zheng Xin Chai , Kong Aik Lee

Advancements in artificial intelligence and machine learning have significantly improved synthetic speech generation. This paper explores diffusion models, a novel method for creating realistic synthetic speech. We create a diffusion…

密码学与安全 · 计算机科学 2025-01-15 Anton Firc , Kamil Malinka , Petr Hanáček

Large Audio-Language Models (LALMs) have recently achieved strong performance across various audio-centric tasks. However, hallucination, where models generate responses that are semantically incorrect or acoustically unsupported, remains…

声音 · 计算机科学 2026-04-22 Feiyu Zhao , Yiming Chen , Wenhuan Lu , Daipeng Zhang , Xianghu Yue , Jianguo Wei

The development of audio foundation models has accelerated rapidly since the emergence of GPT-4o. However, the lack of comprehensive evaluation has become a critical bottleneck for further progress in the field, particularly in audio…