English
Related papers

Related papers: Denoising Adversarial Autoencoders

200 papers

Unsupervised discovery of latent representations, in addition to being useful for density modeling, visualisation and exploratory data analysis, is also increasingly important for learning features relevant to discriminative tasks.…

Machine Learning · Statistics 2011-10-27 Jasper Snoek , Ryan Prescott Adams , Hugo Larochelle

Training a denoising autoencoder neural network requires access to truly clean data, a requirement which is often impractical. To remedy this, we introduce a method to train an autoencoder using only noisy data, having examples with and…

Neural and Evolutionary Computing · Computer Science 2015-09-24 Dan Stowell , Richard E. Turner

Autoencoders exhibit impressive abilities to embed the data manifold into a low-dimensional latent space, making them a staple of representation learning methods. However, without explicit supervision, which is often unavailable, the…

Machine Learning · Computer Science 2023-01-12 Felix Leeb , Stefan Bauer , Michel Besserve , Bernhard Schölkopf

Recent empirical works have successfully used unlabeled data to learn feature representations that are broadly useful in downstream classification tasks. Several of these methods are reminiscent of the well-known word2vec embedding…

Machine Learning · Computer Science 2019-02-26 Sanjeev Arora , Hrishikesh Khandeparkar , Mikhail Khodak , Orestis Plevrakis , Nikunj Saunshi

In recent years, deep discriminative models have achieved extraordinary performance on supervised learning tasks, significantly outperforming their generative counterparts. However, their success relies on the presence of a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Gaurav Pandey , Ambedkar Dukkipati

Parametric and non-parametric classifiers often have to deal with real-world data, where corruptions like noise, occlusions, and blur are unavoidable - posing significant challenges. We present a probabilistic approach to classify strongly…

Machine Learning · Computer Science 2023-04-24 Philipp Joppich , Sebastian Dorn , Oliver De Candido , Wolfgang Utschick , Jakob Knollmüller

Machine Learning models are vulnerable to adversarial attacks that rely on perturbing the input data. This work proposes a novel strategy using Autoencoder Deep Neural Networks to defend a machine learning model against two gradient-based…

Machine Learning · Computer Science 2018-12-10 Rajeev Sahay , Rehana Mahfuz , Aly El Gamal

Supervised learning is based on the assumption that the ground truth in the training data is accurate. However, this may not be guaranteed in real-world settings. Inaccurate training data will result in some unexpected predictions. In image…

Computer Vision and Pattern Recognition · Computer Science 2022-01-06 Yunhao Yang , Andrew Whinston

We show how a deep denoising autoencoder with lateral connections can be used as an auxiliary unsupervised learning task to support supervised learning. The proposed model is trained to minimize simultaneously the sum of supervised and…

Machine Learning · Computer Science 2015-05-01 Antti Rasmus , Harri Valpola , Tapani Raiko

In this paper, we explore new approaches to combining information encoded within the learned representations of auto-encoders. We explore models that are capable of combining the attributes of multiple inputs such that a resynthesised…

In this paper, we introduce a unique variant of the denoising Auto-Encoder and combine it with the perceptual loss to classify images in an unsupervised manner. The proposed method, called Pseudo Labelling, consists of first applying a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Aymene Mohammed Bouayed , Karim Atif , Rachid Deriche , Abdelhakim Saim

Nowadays, Deep learning techniques show dramatic performance on computer vision area, and they even outperform human. But it is also vulnerable to some small perturbation called an adversarial attack. This is a problem combined with the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Seungju Cho , Tae Joon Jun , Byungsoo Oh , Daeyoung Kim

We investigate adversarial attacks for autoencoders. We propose a procedure that distorts the input image to mislead the autoencoder in reconstructing a completely different target image. We attack the internal latent representations,…

Neural and Evolutionary Computing · Computer Science 2016-12-02 Pedro Tabacof , Julia Tavares , Eduardo Valle

Machine learning techniques in particle physics are most powerful when they are trained directly on data, to avoid sensitivity to theoretical uncertainties or an underlying bias on the expected signal. To be able to train on data in…

High Energy Physics - Phenomenology · Physics 2019-10-21 Andrew Blance , Michael Spannowsky , Philip Waite

Regularized autoencoders learn the latent codes, a structure with the regularization under the distribution, which enables them the capability to infer the latent codes given observations and generate new samples given the codes. However,…

Machine Learning · Computer Science 2019-02-18 Wenju Xu , Shawn Keshmiri , Guanghui Wang

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Autoencoders provide a powerful framework for learning compressed representations by encoding all of the information needed to reconstruct a data point in a latent code. In some cases, autoencoders can "interpolate": By decoding the convex…

Machine Learning · Computer Science 2018-07-25 David Berthelot , Colin Raffel , Aurko Roy , Ian Goodfellow

Representation learning from unlabeled data has been extensively studied in statistics, data science and signal processing with a rich literature on techniques for dimension reduction, compression, multi-dimensional scaling among others.…

Machine Learning · Computer Science 2025-10-03 Pascal Esser , Maximilian Fleissner , Debarghya Ghoshdastidar

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

Autoencoders are neural network formulations where the input and output of the network are identical and the goal is to identify the hidden representation in the provided datasets. Generally, autoencoders project the data nonlinearly onto a…

Signal Processing · Electrical Eng. & Systems 2019-07-10 Debjani Bhowick , Deepak K. Gupta , Saumen Maiti , Uma Shankar