English
Related papers

Related papers: Adversarial Ladder Networks

200 papers

Recent research showed that deep neural networks are highly sensitive to so-called adversarial perturbations, which are tiny perturbations of the input data purposely designed to fool a machine learning classifier. Most classification…

Machine Learning · Computer Science 2018-01-15 Akram Erraqabi , Aristide Baratin , Yoshua Bengio , Simon Lacoste-Julien

Ladder networks are a notable new concept in the field of semi-supervised learning by showing state-of-the-art results in image recognition tasks while being compatible with many existing neural architectures. We present the recurrent…

Computation and Language · Computer Science 2017-09-20 Marian Tietz , Tayfun Alpay , Johannes Twiefel , Stefan Wermter

Machine learning and deep learning in particular has advanced tremendously on perceptual tasks in recent years. However, it remains vulnerable against adversarial perturbations of the input that have been crafted specifically to fool the…

Machine Learning · Statistics 2017-02-22 Jan Hendrik Metzen , Tim Genewein , Volker Fischer , Bastian Bischoff

We propose gradient adversarial training, an auxiliary deep learning framework applicable to different machine learning problems. In gradient adversarial training, we leverage a prior belief that in many contexts, simultaneous gradient…

Machine Learning · Computer Science 2018-06-22 Ayan Sinha , Zhao Chen , Vijay Badrinarayanan , Andrew Rabinovich

Deep Neural Networks (DNNs) have recently achieved great success in many classification tasks. Unfortunately, they are vulnerable to adversarial attacks that generate adversarial examples with a small perturbation to fool DNN models,…

Machine Learning · Computer Science 2022-07-07 Xiaowei Zhou , Ivor W. Tsang , Jie Yin

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aritra Ghosh , Andrew Lan

In this study we address the problem of training a neuralnetwork for language identification using both labeled and unlabeled speech samples in the form of i-vectors. We propose a neural network architecture that can also handle out-of-set…

Computation and Language · Computer Science 2016-04-04 Ehud Ben-Reuven , Jacob Goldberger

Manually labeled corpora are expensive to create and often not available for low-resource languages or domains. Automatic labeling approaches are an alternative way to obtain labeled data in a quicker and cheaper way. However, these labels…

Machine Learning · Computer Science 2018-07-24 Michael A. Hedderich , Dietrich Klakow

The success of deep learning is usually accompanied by the growth in neural network depth. However, the traditional training method only supervises the neural network at its last layer and propagates the supervision layer-by-layer, which…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Linfeng Zhang , Xin Chen , Junbo Zhang , Runpei Dong , Kaisheng Ma

In this paper, we introduced the novel concept of advisor network to address the problem of noisy labels in image classification. Deep neural networks (DNN) are prone to performance reduction and overfitting problems on training data with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Simone Ricci , Tiberio Uricchio , Alberto Del Bimbo

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training…

Machine Learning · Computer Science 2020-11-04 Jiacheng Wang , Yue Ma , Shuang Gao

Stochastic Neural Networks (SNNs) that inject noise into their hidden layers have recently been shown to achieve strong robustness against adversarial attacks. However, existing SNNs are usually heuristically motivated, and often rely on…

Machine Learning · Computer Science 2021-05-27 Panagiotis Eustratiadis , Henry Gouk , Da Li , Timothy Hospedales

Semi-supervised learning methods are usually employed in the classification of data sets where only a small subset of the data items is labeled. In these scenarios, label noise is a crucial issue, since the noise may easily spread to a…

Machine Learning · Computer Science 2020-02-14 Fabricio Aparecido Breve , Liang Zhao , Marcos Gonçalves Quiles

In many real-world scenarios, labeled data for a specific machine learning task is costly to obtain. Semi-supervised training methods make use of abundantly available unlabeled data and a smaller number of labeled examples. We propose a new…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Philip Häusser , Alexander Mordvintsev , Daniel Cremers

There has been a growing concern about the fairness of decision-making systems based on machine learning. The shortage of labeled data has been always a challenging problem facing machine learning based systems. In such scenarios,…

Machine Learning · Computer Science 2020-01-01 Vahid Noroozi , Sara Bahaadini , Samira Sheikhi , Nooshin Mojab , Philip S. Yu

Convolutional neural networks provide visual features that perform remarkably well in many computer vision applications. However, training these networks requires significant amounts of supervision. This paper introduces a generic framework…

Machine Learning · Statistics 2017-04-19 Piotr Bojanowski , Armand Joulin

The high cost of data labeling often results in node label shortage in real applications. To improve node classification accuracy, graph-based semi-supervised learning leverages the ample unlabeled nodes to train together with the scarce…

Machine Learning · Computer Science 2023-03-14 Jiaren Xiao , Quanyu Dai , Xiaochen Xie , James Lam , Ka-Wai Kwok

In this paper, we propose another version of help-training approach by employing a Probabilistic Neural Network (PNN) that improves the performance of the main discriminative classifier in the semi-supervised strategy. We introduce the…

Machine Learning · Computer Science 2015-09-07 Hamidreza Farhidzadeh

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance embeddings to be…

Sound · Computer Science 2020-11-02 Jaesung Huh , Hee Soo Heo , Jingu Kang , Shinji Watanabe , Joon Son Chung

Lifted neural networks (i.e. neural architectures explicitly optimizing over respective network potentials to determine the neural activities) can be combined with a type of adversarial training to gain robustness for internal as well as…

Machine Learning · Computer Science 2025-03-12 Christopher Zach