English
Related papers

Related papers: Are Modern Speech Enhancement Systems Vulnerable t…

200 papers

Artificial speech synthesis has made a great leap in terms of naturalness as recent Text-to-Speech (TTS) systems are capable of producing speech with similar quality to human recordings. However, not all speaking styles are easy to model:…

Recent research has found that many families of machine learning models are vulnerable to adversarial examples: inputs that are specifically designed to cause the target model to produce erroneous outputs. In this survey, we focus on…

Machine Learning · Computer Science 2019-11-19 Rey Reza Wiyatno , Anqi Xu , Ousmane Dia , Archy de Berker

The advancements in generative AI have enabled the improvement of audio synthesis models, including text-to-speech and voice conversion. This raises concerns about its potential misuse in social manipulation and political interference, as…

Cryptography and Security · Computer Science 2024-09-12 Hong-Hanh Nguyen-Le , Van-Tuan Tran , Dinh-Thuc Nguyen , Nhien-An Le-Khac

Current reading comprehension models generalise well to in-distribution test sets, yet perform poorly on adversarially selected inputs. Most prior work on adversarial inputs studies oversensitivity: semantically invariant text perturbations…

Computation and Language · Computer Science 2020-03-11 Johannes Welbl , Pasquale Minervini , Max Bartolo , Pontus Stenetorp , Sebastian Riedel

The intelligibility of speech severely degrades in the presence of environmental noise and reverberation. In this paper, we propose a novel deep learning based system for modifying the speech signal to increase its intelligibility under the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Haoyu Li , Junichi Yamagishi

Data augmentation (DA) has gained widespread popularity in deep speaker models due to its ease of implementation and significant effectiveness. It enriches training data by simulating real-life acoustic variations, enabling deep neural…

Sound · Computer Science 2024-02-07 Zhenyu Zhou , Junhui Chen , Namin Wang , Lantian Li , Dong Wang

As Speech Large Language Models (Speech LLMs) become increasingly integrated into voice-based applications, ensuring their robustness against manipulative or adversarial input becomes critical. Although prior work has studied adversarial…

Computation and Language · Computer Science 2026-05-25 Jinyang Wu , Bin Zhu , Xiandong Zou , Qiquan Zhang , Xu Fang , Pan Zhou

Speech enhancement is an essential task of improving speech quality in noise scenario. Several state-of-the-art approaches have introduced visual information for speech enhancement,since the visual aspect of speech is essentially unaffected…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-21 Xinmeng Xu , Yang Wang , Dongxiang Xu , Yiyuan Peng , Cong Zhang , Jie Jia , Binbin Chen

Adversarial examples are inputs intentionally perturbed with the aim of forcing a machine learning model to produce a wrong prediction, while the changes are not easily detectable by a human. Although this topic has been intensively studied…

Machine Learning · Computer Science 2021-02-16 Jon Vadillo , Roberto Santana

Speaker recognition has become very popular in many application scenarios, such as smart homes and smart assistants, due to ease of use for remote control and economic-friendly features. The rapid development of SRSs is inseparable from the…

Cryptography and Security · Computer Science 2022-05-30 Jiahe Lan , Rui Zhang , Zheng Yan , Jie Wang , Yu Chen , Ronghui Hou

Adversarial attacks have exposed a significant security vulnerability in state-of-the-art machine learning models. Among these models include deep reinforcement learning agents. The existing methods for attacking reinforcement learning…

Machine Learning · Computer Science 2020-01-17 Matthew Inkawhich , Yiran Chen , Hai Li

Model inversion (MI) attacks allow to reconstruct average per-class representations of a machine learning (ML) model's training data. It has been shown that in scenarios where each class corresponds to a different individual, such as face…

Sound · Computer Science 2023-01-10 Karla Pizzi , Franziska Boenisch , Ugur Sahin , Konstantin Böttinger

Substantial improvements have been achieved in recent years in voice conversion, which converts the speaker characteristics of an utterance into those of another speaker without changing the linguistic content of the utterance. Nonetheless,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-05 Chien-yu Huang , Yist Y. Lin , Hung-yi Lee , Lin-shan Lee

Voice Processing Systems (VPSes), now widely deployed, have been made significantly more accurate through the application of recent advances in machine learning. However, adversarial machine learning has similarly advanced and has been used…

Cryptography and Security · Computer Science 2019-04-12 Hadi Abdullah , Washington Garcia , Christian Peeters , Patrick Traynor , Kevin R. B. Butler , Joseph Wilson

Advancements in Machine Learning & Neural Networks in recent years have led to widespread implementations of Natural Language Processing across a variety of fields with remarkable success, solving a wide range of complicated problems.…

Computation and Language · Computer Science 2025-11-17 Saadat Rafid Ahmed , Rubayet Shareen , Radoan Sharkar , Nazia Hossain , Mansur Mahi , Farig Yousuf Sadeque

This paper introduces a novel adversarial algorithm for attacking the state-of-the-art speech-to-text systems, namely DeepSpeech, Kaldi, and Lingvo. Our approach is based on developing an extension for the conventional distortion condition…

Sound · Computer Science 2021-03-16 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

The emergence of large-scale automatic speech recognition (ASR) models such as Whisper has greatly expanded their adoption across diverse real-world applications. Ensuring robustness against even minor input perturbations is therefore…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-15 Xiaoxue Gao , Zexin Li , Yiming Chen , Nancy F. Chen

The escalating sophistication of cyberattacks has encouraged the integration of machine learning techniques in intrusion detection systems, but the rise of adversarial examples presents a significant challenge. These crafted perturbations…

Cryptography and Security · Computer Science 2024-06-26 Mohamed Amine Merzouk , Erwan Beurier , Reda Yaich , Nora Boulahia-Cuppens , Frédéric Cuppens

State-of-the-art deep neural networks are known to be vulnerable to adversarial examples, formed by applying small but malicious perturbations to the original inputs. Moreover, the perturbations can \textit{transfer across models}:…

Machine Learning · Statistics 2018-02-28 Lei Wu , Zhanxing Zhu , Cheng Tai , Weinan E

Data augmentation plays a pivotal role in enhancing and diversifying training data. Nonetheless, consistently improving model performance in varied learning scenarios, especially those with inherent data biases, remains challenging. To…

Machine Learning · Computer Science 2024-06-04 Xiaoling Zhou , Wei Ye , Zhemg Lee , Rui Xie , Shikun Zhang