English
Related papers

Related papers: Adversarial Permutation Invariant Training for Uni…

200 papers

Adversarial training is by far the most successful strategy for improving robustness of neural networks to adversarial attacks. Despite its success as a defense mechanism, adversarial training fails to generalize well to unperturbed test…

Machine Learning · Computer Science 2019-10-18 Yogesh Balaji , Tom Goldstein , Judy Hoffman

The teacher-student (T/S) learning has been shown effective in unsupervised domain adaptation [1]. It is a form of transfer learning, not in terms of the transfer of recognition decisions, but the knowledge of posteriori probabilities in…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-01 Zhong Meng , Jinyu Li , Yifan Gong , Biing-Hwang , Juang

Training a robust system, e.g.,Speech to Text (STT), requires large datasets. Variability present in the dataset such as unwanted nuisances and biases are the reason for the need of large datasets to learn general representations. In this…

Sound · Computer Science 2021-10-19 Hemant Yadav , Atul Anshuman Singh , Rachit Mittal , Sunayana Sitaram , Yi Yu , Rajiv Ratn Shah

Besides the well-known classification task, these days neural networks are frequently being applied to generate or transform data, such as images and audio signals. In such tasks, the conventional loss functions like the mean squared error…

Diagnostic procedures for ASD (autism spectrum disorder) involve semi-naturalistic interactions between the child and a clinician. Computational methods to analyze these sessions require an end-to-end speech and language processing pipeline…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-28 Rimita Lahiri , Manoj Kumar , Somer Bishop , Shrikanth Narayanan

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

Machine Learning · Computer Science 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

Deep generative models have emerged as a promising approach in the medical image domain to address data scarcity. However, their use for sequential data like respiratory sounds is less explored. In this work, we propose a straightforward…

Sound · Computer Science 2023-11-14 June-Woo Kim , Chihyeon Yoon , Miika Toikkanen , Sangmin Bae , Ho-Young Jung

Neural language models show vulnerability to adversarial examples which are semantically similar to their original counterparts with a few words replaced by their synonyms. A common way to improve model robustness is adversarial training…

Computation and Language · Computer Science 2022-03-25 Hanjie Chen , Yangfeng Ji

Adversarial training is an approach of increasing the robustness of models to adversarial attacks by including adversarial examples in the training set. One major challenge of producing adversarial examples is to contain sufficient…

Machine Learning · Computer Science 2021-10-13 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

A judicious combination of dictionary learning methods, block sparsity and source recovery algorithm are used in a hierarchical manner to identify the noises and the speakers from a noisy conversation between two people. Conversations are…

Sound · Computer Science 2016-10-31 K V Vijay Girish , A G Ramakrishnan , T V Ananthapadmanabha

Deep learning techniques for separating audio into different sound sources face several challenges. Standard architectures require training separate models for different types of audio sources. Although some universal separators employ a…

Sound · Computer Science 2022-02-15 Ke Chen , Xingjian Du , Bilei Zhu , Zejun Ma , Taylor Berg-Kirkpatrick , Shlomo Dubnov

Recent deep learning approaches have achieved impressive performance on speech enhancement and separation tasks. However, these approaches have not been investigated for separating mixtures of arbitrary sounds of different types, a task we…

Neural networks are susceptible to adversarial examples-small input perturbations that cause models to fail. Adversarial training is one of the solutions that stops adversarial examples; models are exposed to attacks during training and…

Machine Learning · Computer Science 2022-07-05 Maximilian Kaufmann , Yiren Zhao , Ilia Shumailov , Robert Mullins , Nicolas Papernot

Under noisy environments, to achieve the robust performance of speaker recognition is still a challenging task. Motivated by the promising performance of multi-task training in a variety of image processing tasks, we explore the potential…

Sound · Computer Science 2019-05-14 Jianfeng Zhou , Tao Jiang , Lin Li , Qingyang Hong , Zhe Wang , Bingyin Xia

Separating audio mixtures into individual instrument tracks has been a long standing challenging task. We introduce a novel weakly supervised audio source separation approach based on deep adversarial learning. Specifically, our loss…

Sound · Computer Science 2018-05-18 Ning Zhang , Junchi Yan , Yuchen Zhou

Deep Neural Networks have been shown to be vulnerable to various kinds of adversarial perturbations. In addition to widely studied additive noise based perturbations, adversarial examples can also be created by applying a per pixel spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Ayberk Aydin , Deniz Sen , Berat Tuna Karli , Oguz Hanoglu , Alptekin Temizel

Neural Machine Translation (NMT) models are known to suffer from noisy inputs. To make models robust, we generate adversarial augmentation samples that attack the model and preserve the source-side semantic meaning at the same time. To…

Computation and Language · Computer Science 2021-10-13 Weiting Tan , Shuoyang Ding , Huda Khayrallah , Philipp Koehn

Supervised learning models are challenged by the intrinsic complexities of training data such as outliers and minority subpopulations and intentional attacks at inference time with adversarial samples. While traditional robust learning…

Machine Learning · Computer Science 2023-09-12 Shu Hu , Zhenhuan Yang , Xin Wang , Yiming Ying , Siwei Lyu

Speech emotion recognition (SER) has attracted great attention in recent years due to the high demand for emotionally intelligent speech interfaces. Deriving speaker-invariant representations for speech emotion recognition is crucial. In…

Audio and Speech Processing · Electrical Eng. & Systems 2019-03-25 Ming Tu , Yun Tang , Jing Huang , Xiaodong He , Bowen Zhou

Although great progresses have been made in automatic speech recognition (ASR), significant performance degradation is still observed when recognizing multi-talker mixed speech. In this paper, we propose and evaluate several architectures…

Sound · Computer Science 2018-12-06 Yanmin Qian , Xuankai Chang , Dong Yu