English
Related papers

Related papers: Open Challenges in Synthetic Speech Detection

200 papers

Speech dysfluency detection is crucial for clinical diagnosis and language assessment, but existing methods are limited by the scarcity of high-quality annotated data. Although recent advances in TTS model have enabled synthetic dysfluency…

The rapid proliferation of AI-manipulated or generated audio deepfakes poses serious challenges to media integrity and election security. Current AI-driven detection solutions lack explainability and underperform in real-world settings. In…

Machine Learning · Computer Science 2024-10-11 Georgia Channing , Juil Sock , Ronald Clark , Philip Torr , Christian Schroeder de Witt

Many ground-breaking advancements in machine learning can be attributed to the availability of a large volume of rich data. Unfortunately, many large-scale datasets are highly sensitive, such as healthcare data, and are not widely available…

Machine Learning · Computer Science 2020-12-09 James Jordon , Alan Wilson , Mihaela van der Schaar

This report characterized the suitability of existing datasets for devising new Machine Learning models, decision making methods, and analysis algorithms to improve Collaborative Problem Solving and then enumerated requirements for future…

Machine Learning · Computer Science 2024-12-25 Gnaneswar Villuri , Alex Doboli

Current synthetic speech detection (SSD) methods perform well on certain datasets but still face issues of robustness and interpretability. A possible reason is that these methods do not analyze the deficiencies of synthetic speech. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-02 Yuxiang Zhang , Zhuo Li , Jingze Lu , Wenchao Wang , Pengyuan Zhang

Recent advances in singing voice synthesis (SVS) have attracted substantial attention from both academia and industry. With the advent of large language models and novel generative paradigms, producing controllable, high-fidelity singing…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Changhao Pan , Dongyu Yao , Yu Zhang , Wenxiang Guo , Jingyu Lu , Zhiyuan Zhu , Zhou Zhao

This paper presents Task 7 at the DCASE 2024 Challenge: sound scene synthesis. Recent advances in sound synthesis and generative models have enabled the creation of realistic and diverse audio content. We introduce a standardized evaluation…

Artificial Intelligence · Computer Science 2025-01-16 Mathieu Lagrange , Junwon Lee , Modan Tailleur , Laurie M. Heller , Keunwoo Choi , Brian McFee , Keisuke Imoto , Yuki Okamoto

Shared challenges provide a venue for comparing systems trained on common data using a standardized evaluation, and they also provide an invaluable resource for researchers when the data and evaluation results are publicly released. The…

Sound · Computer Science 2021-07-01 Erica Cooper , Junichi Yamagishi

This perspective calls for scholars across disciplines to address the challenge of audio deepfake detection and discernment through an interdisciplinary lens across Artificial Intelligence methods and linguistics. With an avalanche of tools…

Sound · Computer Science 2024-11-12 Vandana P. Janeja , Christine Mallinson

A significant impediment to progress in research on bias in machine learning (ML) is the availability of relevant datasets. This situation is unlikely to change much given the sensitivity of such data. For this reason, there is a role for…

Machine Learning · Computer Science 2021-08-05 William Blanzeisky , Pádraig Cunningham , Kenneth Kennedy

Output from statistical parametric speech synthesis (SPSS) remains noticeably worse than natural speech recordings in terms of quality, naturalness, speaker similarity, and intelligibility in noise. There are many hypotheses regarding the…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-31 Gustav Eje Henter , Simon King , Thomas Merritt , Gilles Degottex

Deepfake speech utterances can be forged by replacing one or more words in a bona fide utterance with semantically different words synthesized with speech-generative models. While a dedicated synthetic word detector could be developed, we…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-03 Hoan My Tran , Xin Wang , Wanying Ge , Xuechen Liu , Junichi Yamagishi

As audio deepfakes transition from research artifacts to widely available commercial tools, robust biometric authentication faces pressing security threats in high-stakes industries. This paper presents a systematic empirical evaluation of…

Sound · Computer Science 2026-01-07 Mengze Hong , Di Jiang , Zeying Xie , Weiwei Zhao , Guan Wang , Chen Jason Zhang

Recent success of the Tacotron speech synthesis architecture and its variants in producing natural sounding multi-speaker synthesized speech has raised the exciting possibility of replacing expensive, manually transcribed, domain-specific,…

Computation and Language · Computer Science 2019-09-27 Andrew Rosenberg , Yu Zhang , Bhuvana Ramabhadran , Ye Jia , Pedro Moreno , Yonghui Wu , Zelin Wu

Describes an audio dataset of spoken words designed to help train and evaluate keyword spotting systems. Discusses why this task is an interesting challenge, and why it requires a specialized dataset that is different from conventional…

Computation and Language · Computer Science 2018-04-11 Pete Warden

Many datasets have been designed to further the development of fake audio detection. However, fake utterances in previous datasets are mostly generated by altering timbre, prosody, linguistic content or channel noise of original audio.…

Recent advances in generative models for language have enabled the creation of convincing synthetic text or deepfake text. Prior work has demonstrated the potential for misuse of deepfake text to mislead content consumers. Therefore,…

Cryptography and Security · Computer Science 2022-10-19 Jiameng Pu , Zain Sarwar , Sifat Muhammad Abdullah , Abdullah Rehman , Yoonjin Kim , Parantapa Bhattacharya , Mobin Javed , Bimal Viswanath

ASVspoof 2021 is the forth edition in the series of bi-annual challenges which aim to promote the study of spoofing and the design of countermeasures to protect automatic speaker verification systems from manipulation. In addition to a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Junichi Yamagishi , Xin Wang , Massimiliano Todisco , Md Sahidullah , Jose Patino , Andreas Nautsch , Xuechen Liu , Kong Aik Lee , Tomi Kinnunen , Nicholas Evans , Héctor Delgado

The emergence of generative AI models has dramatically expanded the availability and use of synthetic data across scientific, industrial, and policy domains. While these developments open new possibilities for data analysis, they also raise…

Machine Learning · Statistics 2026-03-06 Ahmad Abdel-Azim , Ruoyu Wang , Xihong Lin

Recent advances in text-to-speech (TTS) systems, particularly those with voice cloning capabilities, have made voice impersonation readily accessible, raising ethical and legal concerns due to potential misuse for malicious activities like…

Sound · Computer Science 2024-10-10 Hongbin Liu , Youzheng Chen , Arun Narayanan , Athula Balachandran , Pedro J. Moreno , Lun Wang