English
Related papers

Related papers: What Regularized Auto-Encoders Learn from the Data…

200 papers

Manifold learning aims to discover and represent low-dimensional structures underlying high-dimensional data while preserving critical topological and geometric properties. Existing methods often fail to capture local details with global…

Machine Learning · Computer Science 2025-05-08 Ren Wang , Pengcheng Zhou

Autoencoders are commonly used in representation learning. They consist of an encoder and a decoder, which provide a straightforward way to map n-dimensional data in input space to a lower m-dimensional representation space and back. The…

Machine Learning · Computer Science 2021-11-16 Viktoria Schuster , Anders Krogh

Autoencoders are certainly among the most studied and used Deep Learning models: the idea behind them is to train a model in order to reconstruct the same input data. The peculiarity of these models is to compress the information through a…

Machine Learning · Computer Science 2023-09-06 Gabriele Martino , Davide Moroni , Massimo Martinelli

Traditionally, when generative models of data are developed via deep architectures, greedy layer-wise pre-training is employed. In a well-trained model, the lower layer of the architecture models the data distribution conditional upon the…

Machine Learning · Statistics 2015-06-17 Yingbo Zhou , Devansh Arpit , Ifeoma Nwogu , Venu Govindaraju

A new method for the unsupervised learning of sparse representations using autoencoders is proposed and implemented by ordering the output of the hidden units by their activation value and progressively reconstructing the input in this…

Machine Learning · Computer Science 2016-05-09 Paul Bertens

Automatically learning features, especially robust features, has attracted much attention in the machine learning community. In this paper, we propose a new method to learn non-linear robust features by taking advantage of the data manifold…

Machine Learning · Computer Science 2017-05-29 Yanan Li , Donghui Wang

Autoencoders are unsupervised deep learning models used for learning representations. In literature, autoencoders have shown to perform well on a variety of tasks spread across multiple domains, thereby establishing widespread…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Maneet Singh , Shruti Nagpal , Mayank Vatsa , Richa Singh , Afzel Noore

Autoencoders are neural network formulations where the input and output of the network are identical and the goal is to identify the hidden representation in the provided datasets. Generally, autoencoders project the data nonlinearly onto a…

Signal Processing · Electrical Eng. & Systems 2019-07-10 Debjani Bhowick , Deepak K. Gupta , Saumen Maiti , Uma Shankar

We discuss an autoencoder model in which the encoding and decoding functions are implemented by decision trees. We use the soft decision tree where internal nodes realize soft multivariate splits given by a gating function and the overall…

Machine Learning · Computer Science 2014-09-29 Ozan İrsoy , Ethem Alpaydın

Anomaly detection and localization without any manual annotations and prior knowledge is a challenging task under the setting of unsupervised learning. The existing works achieve excellent performance in the anomaly detection, but with…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Honghui Chen , Pingping Chen , Huan Mao , Mengxi Jiang

There is an increasingly apparent need for validating the classifications made by deep learning systems in safety-critical applications like autonomous vehicle systems. A number of recent papers have proposed methods for detecting anomalous…

Machine Learning · Computer Science 2018-12-10 Taylor Denouden , Rick Salay , Krzysztof Czarnecki , Vahdat Abdelzad , Buu Phan , Sachin Vernekar

Dimensionality reduction is a crucial first step for many unsupervised learning tasks including anomaly detection and clustering. Autoencoder is a popular mechanism to accomplish dimensionality reduction. In order to make dimensionality…

Machine Learning · Computer Science 2021-03-12 Imtiaz Ahmed , Travis Galoppo , Xia Hu , Yu Ding

Unsupervised anomaly detection is a challenging task. Autoencoders (AEs) or generative models are often employed to model the data distribution of normal inputs and subsequently identify anomalous, out-of-distribution inputs by high…

Machine Learning · Computer Science 2025-06-12 Yalin Liao , Austin J. Brockmeier

We propose a principled method for autoencoding with random forests. Our strategy builds on foundational results from nonparametric statistics and spectral graph theory to learn a low-dimensional embedding of the model that optimally…

Machine Learning · Statistics 2026-01-16 Binh Duc Vu , Jan Kapar , Marvin Wright , David S. Watson

This paper proposes a theoretical framework on the mechanism of autoencoders. To the encoder part, under the main use of dimensionality reduction, we investigate its two fundamental properties: bijective maps and data disentangling. The…

Machine Learning · Computer Science 2022-12-13 Changcun Huang

This study proposes an automated data mining framework based on autoencoders and experimentally verifies its effectiveness in feature extraction and data dimensionality reduction. Through the encoding-decoding structure, the autoencoder can…

Machine Learning · Computer Science 2024-12-04 Yaxin Liang , Xinshi Li , Xin Huang , Ziqi Zhang , Yue Yao

Diffusion models often generate novel samples even when the learned score is only \emph{coarse} -- a phenomenon not accounted for by the standard view of diffusion training as density estimation. In this paper, we show that, under the…

Machine Learning · Computer Science 2026-03-26 Zebang Shen , Ya-Ping Hsieh , Niao He

Unsupervised learning is of growing interest because it unlocks the potential held in vast amounts of unlabelled data to learn useful representations for inference. Autoencoders, a form of generative model, may be trained by learning to…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Antonia Creswell , Anil Anthony Bharath

Objective: This paper investigates how generative models, trained on ground-truth images, can be used \changes{as} priors for inverse problems, penalizing reconstructions far from images the generator can produce. The aim is that learned…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Margaret Duff , Ivor J. A. Simpson , Matthias J. Ehrhardt , Neill D. F. Campbell

Autoencoders have seen wide success in domains ranging from feature selection to information retrieval. Despite this success, designing an autoencoder for a given task remains a challenging undertaking due to the lack of firm intuition on…

Neural and Evolutionary Computing · Computer Science 2020-04-17 Jeff Hajewski , Suely Oliveira , Xiaoyu Xing