English
Related papers

Related papers: Speech Foundation Model Ensembles for the Controll…

200 papers

The rapid advancement of AI-generated singing voices, which now closely mimic natural human singing and align seamlessly with musical scores, has led to heightened concerns for artists and the music industry. Unlike spoken voice, singing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-09 You Zhang , Yongyi Zang , Jiatong Shi , Ryuichi Yamamoto , Jionghao Han , Yuxun Tang , Tomoki Toda , Zhiyao Duan

With the advancements in singing voice generation and the growing presence of AI singers on media platforms, the inaugural Singing Voice Deepfake Detection (SVDD) Challenge aims to advance research in identifying AI-generated singing voices…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 You Zhang , Yongyi Zang , Jiatong Shi , Ryuichi Yamamoto , Tomoki Toda , Zhiyao Duan

The deepfake generation of singing vocals is a concerning issue for artists in the music industry. In this work, we propose a singing voice deepfake detection (SVDD) system, which uses noise-variant encodings of open-AI's Whisper model. As…

Sound · Computer Science 2025-02-03 Falguni Sharma , Priyanka Gupta

Recent singing voice synthesis and conversion advancements necessitate robust singing voice deepfake detection (SVDD) models. Current SVDD datasets face challenges due to limited controllability, diversity in deepfake methods, and licensing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Yongyi Zang , Jiatong Shi , You Zhang , Ryuichi Yamamoto , Jionghao Han , Yuxun Tang , Shengyuan Xu , Wenxiao Zhao , Jing Guo , Tomoki Toda , Zhiyao Duan

In this study, for the first time, we extensively investigate whether music foundation models (MFMs) or speech foundation models (SFMs) work better for singing voice deepfake detection (SVDD), which has recently attracted attention in the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-24 Orchid Chetia Phukan , Sarthak Jain , Swarup Ranjan Behera , Arun Balaji Buduru , Rajesh Sharma , S. R Mahadeva Prasanna

Speech deepfake detection (SDD) systems perform well on standard benchmarks datasets but often fail to generalize to expressive and emotional spoofing attacks. Many methods rely on spoof-heavy training data, learning dataset-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-16 Aurosweta Mahapatra , Ismail Rasim Ulgen , Kong Aik Lee , Nicholas Andrews , Berrak Sisman

Rapid advances in singing voice synthesis have increased unauthorized imitation risks, creating an urgent need for better Singing Voice Deepfake (SingFake) Detection, also known as SVDD. Unlike speech, singing contains complex pitch, wide…

Sound · Computer Science 2026-04-07 Xuanjun Chen , Chia-Yu Hu , Sung-Feng Huang , Haibin Wu , Hung-yi Lee , Jyh-Shing Roger Jang

This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level deepfake detection using the CompSpoofV2 dataset, where speech and environmental sounds…

Sound · Computer Science 2026-05-06 Khalid Zaman , Qixuan Huang , Muhammad Uzair , Masashi Unoki

This paper introduces the model structure used in the SVDD 2024 Challenge. The SVDD 2024 challenge has been introduced this year for the first time. Singing voice deepfake detection (SVDD) which faces complexities due to informal speech…

Sound · Computer Science 2024-10-03 Qishan Zhang , Shuangbing Wen , Fangke Yan , Tao Hu , Jun Li

With rapid advances in audio-visual generative models, reliable forgery detection becomes increasingly critical. Existing methods for audio-visual deepfake detection typically rely on cross-modal inconsistencies. In singing, rhythmic…

Artificial Intelligence · Computer Science 2026-05-28 Ke Liu , Jiwei Wei , Wenyu Zhang , Shuchang Zhou , Ruikun Chai , Yutao Dai , Chaoning Zhang , Yang Yang

This paper describes the BUT submission to the ESDD 2026 Challenge, specifically focusing on Track 1: Environmental Sound Deepfake Detection with Unseen Generators. To address the critical challenge of generalizing to audio generated by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-10 Junyi Peng , Lin Zhang , Jin Li , Oldrich Plchot , Jan Cernocky

The present paper proposes a waveform boundary detection system for audio spoofing attacks containing partially manipulated segments. Partially spoofed/fake audio, where part of the utterance is replaced, either with synthetic or natural…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Zexin Cai , Weiqing Wang , Ming Li

This study aims to develop a single integrated spoofing-aware speaker verification (SASV) embeddings that satisfy two aspects. First, rejecting non-target speakers' input as well as target speakers' spoofed inputs should be addressed.…

Recent years have witnessed the extraordinary development of automatic speaker verification (ASV). However, previous works show that state-of-the-art ASV models are seriously vulnerable to voice spoofing attacks, and the recently proposed…

Sound · Computer Science 2022-06-22 Haibin Wu , Jiawen Kang , Lingwei Meng , Yang Zhang , Xixin Wu , Zhiyong Wu , Hung-yi Lee , Helen Meng

Recent progress in audio generation has made it increasingly easy to create highly realistic environmental soundscapes, which can be misused to produce deceptive content, such as fake alarms, gunshots, and crowd sounds, raising concerns for…

Sound · Computer Science 2026-03-10 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Ting Dang

Detecting spoofing attempts of automatic speaker verification (ASV) systems is challenging, especially when using only one modeling approach. For robustness, we use both deep neural networks and traditional machine learning models and…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-05 Bhusan Chettri , Daniel Stoller , Veronica Morfi , Marco A. Martínez Ramírez , Emmanouil Benetos , Bob L. Sturm

The use of deep neural networks (DNN) has dramatically elevated the performance of automatic speaker verification (ASV) over the last decade. However, ASV systems can be easily neutralized by spoofing attacks. Therefore, the Spoofing-Aware…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Jungwoo Heo , Ju-ho Kim , Hyun-seo Shin

Research in the past several years has boosted the performance of automatic speaker verification systems and countermeasure systems to deliver low Equal Error Rates (EERs) on each system. However, research on joint optimization of both…

Sound · Computer Science 2022-03-28 Zhongwei Teng , Quchen Fu , Jules White , Maria E. Powell , Douglas C. Schmidt

Deep learning has brought impressive progress in the study of both automatic speaker verification (ASV) and spoofing countermeasures (CM). Although solutions are mutually dependent, they have typically evolved as standalone sub-systems…

This paper describes the NPU system submitted to Spoofing Aware Speaker Verification Challenge 2022. We particularly focus on the \textit{backend ensemble} for speaker verification and spoofing countermeasure from three aspects. Firstly,…

Sound · Computer Science 2022-09-26 Li Zhang , Yue Li , Huan Zhao , Qing Wang , Lei Xie
‹ Prev 1 2 3 10 Next ›