English
Related papers

Related papers: Trade-offs Between Capacity and Robustness in Neur…

200 papers

In realistic environments, speech is usually interfered by various noise and reverberation, which dramatically degrades the performance of automatic speech recognition (ASR) systems. To alleviate this issue, the commonest way is to use a…

Sound · Computer Science 2018-05-04 Bin Liu , Shuai Nie , Yaping Zhang , Dengfeng Ke , Shan Liang , Wenju Liu1

Automatic Speaker Verification (ASV), increasingly used in security-critical applications, faces vulnerabilities from rising adversarial attacks, with few effective defenses available. In this paper, we propose a neural codec-based…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-10 Xuanjun Chen , Jiawei Du , Haibin Wu , Jyh-Shing Roger Jang , Hung-yi Lee

There has been a recent surge in adversarial attacks on deep learning based automatic speech recognition (ASR) systems. These attacks pose new challenges to deep learning security and have raised significant concerns in deploying ASR…

Cryptography and Security · Computer Science 2021-03-08 Shehzeen Hussain , Paarth Neekhara , Shlomo Dubnov , Julian McAuley , Farinaz Koushanfar

Deep neural networks are vulnerable to adversarial attacks, which can fool them by adding minuscule perturbations to the input images. The robustness of existing defenses suffers greatly under white-box attack settings, where an adversary…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Aamir Mustafa , Salman Khan , Munawar Hayat , Roland Goecke , Jianbing Shen , Ling Shao

This paper explores the integration of model-based and data-driven approaches within the realm of neural speech and audio coding systems. It highlights the challenges posed by the subjective evaluation processes of speech and audio codecs…

Sound · Computer Science 2025-01-08 Minje Kim , Jan Skoglund

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

Machine Learning · Computer Science 2020-08-13 Alex Serban , Erik Poll , Joost Visser

Residual Vector Quantization (RVQ) has become a dominant approach in neural speech and audio coding, providing high-fidelity compression. However, speech coding presents additional challenges due to real-world noise, which degrades…

Sound · Computer Science 2025-06-23 Yunkee Chae , Kyogu Lee

In recent years, significant progress has been made in deep model-based automatic speech recognition (ASR), leading to its widespread deployment in the real world. At the same time, adversarial attacks against deep ASR systems are highly…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-04 Christian Heider Nielsen , Zheng-Hua Tan

Deep learning models can be fooled by small $l_p$-norm adversarial perturbations and natural perturbations in terms of attributes. Although the robustness against each perturbation has been explored, it remains a challenge to address the…

Machine Learning · Computer Science 2023-04-11 Dashan Gao , Yunce Zhao , Yinghua Yao , Zeqi Zhang , Bifei Mao , Xin Yao

Adversarial attack methods have demonstrated the fragility of deep neural networks. Their imperceptible perturbations are frequently able fool classifiers into potentially dangerous misclassifications. We propose a novel way to interpret…

Machine Learning · Computer Science 2018-03-22 Joachim Folz , Sebastian Palacio , Joern Hees , Damian Borth , Andreas Dengel

Deep neural networks are incredibly vulnerable to crafted, human-imperceptible adversarial perturbations. Although adversarial training (AT) has proven to be an effective defense approach, we find that the AT-trained models heavily rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Binxiao Huang , Chaofan Tao , Rui Lin , Ngai Wong

We propose a novel data-dependent structured gradient regularizer to increase the robustness of neural networks vis-a-vis adversarial perturbations. Our regularizer can be derived as a controlled approximation from first principles,…

Machine Learning · Statistics 2018-05-23 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

Adversarial perturbations in speech pose a serious threat to automatic speech recognition (ASR) and speaker verification by introducing subtle waveform modifications that remain imperceptible to humans but can significantly alter system…

Sound · Computer Science 2026-02-02 Daniyal Kabir Dar , Qiben Yan , Li Xiao , Arun Ross

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

Machine Learning · Computer Science 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

The adversarial attacks against deep neural networks on computer vision tasks have spawned many new technologies that help protect models from avoiding false predictions. Recently, word-level adversarial attacks on deep models of Natural…

Computation and Language · Computer Science 2020-06-15 Zhaoyang Wang , Hongtao Wang

In light of the widespread application of Automatic Speech Recognition (ASR) systems, their security concerns have received much more attention than ever before, primarily due to the susceptibility of Deep Neural Networks. Previous studies…

Sound · Computer Science 2024-05-16 Weifei Jin , Yuxin Cao , Junjie Su , Qi Shen , Kai Ye , Derui Wang , Jie Hao , Ziyao Liu

Adversarial robustness refers to a model's ability to resist perturbation of inputs, while distribution robustness evaluates the performance of the model under data shifts. Although both aim to ensure reliable performance, prior work has…

Machine Learning · Computer Science 2026-01-26 Yipei Wang , Zhaoying Pan , Xiaoqian Wang

Neural speech codecs have demonstrated their ability to compress high-quality speech and audio by converting them into discrete token representations. Most existing methods utilize Residual Vector Quantization (RVQ) to encode speech into…

Sound · Computer Science 2024-10-22 Peiji Yang , Fengping Wang , Yicheng Zhong , Huawei Wei , Zhisheng Wang

A key challenge for Deep Neural Network (DNN) algorithms is their vulnerability to adversarial attacks. Inherently non-deterministic compute substrates, such as those based on Analog In-Memory Computing (AIMC), have been speculated to…

Emerging Technologies · Computer Science 2025-03-07 Corey Lammie , Julian Büchel , Athanasios Vasilopoulos , Manuel Le Gallo , Abu Sebastian

Deep neural networks (DNNs) are powerful nonlinear architectures that are known to be robust to random perturbations of the input. However, these models are vulnerable to adversarial perturbations--small input changes crafted explicitly to…

Machine Learning · Statistics 2017-11-17 Reuben Feinman , Ryan R. Curtin , Saurabh Shintre , Andrew B. Gardner