English
Related papers

Related papers: CloneShield: A Framework for Universal Perturbatio…

200 papers

Large language model (LLM) based zero-shot text-to-speech (TTS) methods tend to preserve the acoustic environment of the audio prompt, leading to degradation in synthesized speech quality when the audio prompt contains noise. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Ye-Xin Lu , Hui-Peng Du , Fei Liu , Yang Ai , Zhen-Hua Ling

Deep joint source-channel coding (DeepJSCC) has emerged as a promising paradigm for efficient and robust information transmission. However, its intrinsic characteristics also pose new security challenges, notably an increased vulnerability…

Signal Processing · Electrical Eng. & Systems 2025-12-23 Kaiyi Chi , Yinghui He , Qianqian Yang , Yuanchao Shu , Zhiqin Wang , Jun Luo , Jiming Chen

The challenge of fairness arises when Automatic Speech Recognition (ASR) systems do not perform equally well for all sub-groups of the population. In the past few years there have been many improvements in overall speech recognition…

Sound · Computer Science 2023-06-12 Irina-Elena Veliche , Pascale Fung

While spatiotemporal deepfake detectors achieve high AUC, our experiments reveal their susceptibility to evasion attacks. These models tend to overfit on fragile temporal spectrum cues, rather than learning robust semantic causality. To…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Zheyuan Gu , Minghao Shao , Zhen Wang , Yusong Wang , Mingkun Xu , Shijie Zhang , Hao Jiang

We present a novel benchmark for voice cloning text-to-speech models. The benchmark consists of an evaluation protocol, an open-source library for assessing the performance of voice cloning models, and an accompanying leaderboard. The paper…

Computation and Language · Computer Science 2025-09-18 Iwona Christop , Tomasz Kuczyński , Marek Kubis

Flow-Matching (FM)-based zero-shot text-to-speech (TTS) systems exhibit high-quality speech synthesis and robust generalization capabilities. However, the speaker representation ability of such systems remains underexplored, primarily due…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-18 Haoyu Li , Mingyang Han , Yu Xi , Dongxiao Wang , Hankun Wang , Haoxiang Shi , Boyu Li , Jun Song , Bo Zheng , Shuai Wang , Kai Yu

In authentication scenarios, applications of practical speaker verification systems usually require a person to read a dynamic authentication text. Previous studies played an audio adversarial example as a digital signal to perform physical…

Sound · Computer Science 2021-05-20 Weiyi Zhang , Shuning Zhao , Le Liu , Jianmin Li , Xingliang Cheng , Thomas Fang Zheng , Xiaolin Hu

Domain mismatch problem caused by speaker-unrelated feature has been a major topic in speaker recognition. In this paper, we propose an explicit disentanglement framework to unravel speaker-relevant features from speaker-unrelated features…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-13 Sung Hwan Mun , Min Hyun Han , Minchan Kim , Dongjune Lee , Nam Soo Kim

Automatic speech recognition systems have created exciting possibilities for applications, however they also enable opportunities for systematic eavesdropping. We propose a method to camouflage a person's voice over-the-air from these…

Sound · Computer Science 2022-02-18 Mia Chiquier , Chengzhi Mao , Carl Vondrick

This paper proposes a simple and robust zero-shot voice conversion system with a cycle structure and mel-spectrogram pre-processing. Previous works suffer from information loss and poor synthesis quality due to their reliance on a carefully…

Sound · Computer Science 2023-10-11 Haeyun Choi , Jio Gim , Yuho Lee , Youngin Kim , Young-Joo Suh

Automatic speech recognition (ASR) systems have been widely deployed in modern smart devices to provide convenient and diverse voice-controlled services. Since ASR systems are vulnerable to audio replay attacks that can spoof and mislead…

Cryptography and Security · Computer Science 2022-08-05 Shu Wang , Jiahao Cao , Xu He , Kun Sun , Qi Li

Privacy and security are major concerns when communicating speech signals to cloud services such as automatic speech recognition (ASR) and speech emotion recognition (SER). Existing solutions for speech anonymization mainly focus on voice…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Minh Tran , Mohammad Soleymani

The rapid advancement of AI has enabled highly realistic speech synthesis and voice cloning, posing serious risks to voice authentication, smart assistants, and telecom security. While most prior work frames spoof detection as a binary…

Sound · Computer Science 2025-09-10 Bin Hu , Kunyang Huang , Daehan Kwak , Meng Xu , Kuan Huang

Zero-shot singing voice synthesis (SVS) with style transfer and style control aims to generate high-quality singing voices with unseen timbres and styles (including singing method, emotion, rhythm, technique, and pronunciation) from audio…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-02 Yu Zhang , Ziyue Jiang , Ruiqi Li , Changhao Pan , Jinzheng He , Rongjie Huang , Chuxin Wang , Zhou Zhao

Text-to-Speech (TTS) diffusion models generate high-quality speech, which raises challenges for the model intellectual property protection and speech tracing for legal use. Audio watermarking is a promising solution. However, due to the…

Sound · Computer Science 2025-12-23 Yichuan Zhang , Chengxin Li , Yujie Gu

Customizable keyword spotting (KWS) in continuous speech has attracted increasing attention due to its real-world application potential. While contrastive learning (CL) has been widely used to extract keyword representations, previous CL…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-15 Yu Xi , Baochen Yang , Hao Li , Jiaqi Guo , Kai Yu

We introduce StyleFusion-TTS, a prompt and/or audio referenced, style and speaker-controllable, zero-shot text-to-speech (TTS) synthesis system designed to enhance the editability and naturalness of current research literature. We propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Zhiyong Chen , Xinnuo Li , Zhiqi Ai , Shugong Xu

Audio deepfakes pose a growing threat, already exploited in fraud and misinformation. A key challenge is ensuring detectors remain robust to unseen synthesis methods and diverse speakers, since generation techniques evolve quickly. Despite…

Sound · Computer Science 2025-10-28 Jiyoung Hong , Yoonseo Chung , Seungyeon Oh , Juntae Kim , Jiyoung Lee , Sookyung Kim , Hyunsoo Cho

This paper introduces a novel adversarial algorithm for attacking the state-of-the-art speech-to-text systems, namely DeepSpeech, Kaldi, and Lingvo. Our approach is based on developing an extension for the conventional distortion condition…

Sound · Computer Science 2021-03-16 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

In this paper, we propose SC-GlowTTS: an efficient zero-shot multi-speaker text-to-speech model that improves similarity for speakers unseen during training. We propose a speaker-conditional architecture that explores a flow-based decoder…