English
Related papers

Related papers: On Nonparametric Guidance for Learning Autoencoder…

200 papers

The application of convolutional autoencoder deep learning to imaging data for planetary science and astrobiological use is briefly reviewed and explored with a focus on the need to understand algorithmic rationale, process, and results…

Earth and Planetary Astrophysics · Physics 2025-07-16 Caleb Scharf

We propose split-brain autoencoders, a straightforward modification of the traditional autoencoder architecture, for unsupervised representation learning. The method adds a split to the network, resulting in two disjoint sub-networks. Each…

Computer Vision and Pattern Recognition · Computer Science 2017-04-21 Richard Zhang , Phillip Isola , Alexei A. Efros

Variational autoencoders model high-dimensional data by positing low-dimensional latent variables that are mapped through a flexible distribution parametrized by a neural network. Unfortunately, variational autoencoders often suffer from…

Machine Learning · Statistics 2023-01-03 Yixin Wang , David M. Blei , John P. Cunningham

Inductive biases are crucial in disentangled representation learning for narrowing down an underspecified solution set. In this work, we consider endowing a neural network autoencoder with three select inductive biases from the literature:…

Machine Learning · Computer Science 2024-05-28 Kyle Hsu , Jubayer Ibn Hamid , Kaylee Burns , Chelsea Finn , Jiajun Wu

Object discovery -- separating objects from the background without manual labels -- is a fundamental open challenge in computer vision. Previous methods struggle to go beyond clustering of low-level cues, whether handcrafted (e.g., color,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Zhipeng Bao , Pavel Tokmakov , Yu-Xiong Wang , Adrien Gaidon , Martial Hebert

Autoencoders learn data representations (codes) in such a way that the input is reproduced at the output of the network. However, it is not always clear what kind of properties of the input data need to be captured by the codes. Kernel…

Machine Learning · Statistics 2018-07-24 Michael Kampffmeyer , Sigurd Løkse , Filippo M. Bianchi , Robert Jenssen , Lorenzo Livi

Variational autoencoders provide a principled framework for learning deep latent-variable models and corresponding inference models. In this work, we provide an introduction to variational autoencoders and some important extensions.

Machine Learning · Computer Science 2019-12-12 Diederik P. Kingma , Max Welling

In the domain of computer vision, deep residual neural networks like EfficientNet have set new standards in terms of robustness and accuracy. One key problem underlying the training of deep neural networks is the immanent lack of a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Raoul Schönhof , Jannes Elstner , Radu Manea , Steffen Tauber , Ramez Awad , Marco F. Huber

Learning data representations that reflect the customers' creditworthiness can improve marketing campaigns, customer relationship management, data and process management or the credit risk assessment in retail banks. In this research, we…

Machine Learning · Statistics 2019-03-18 Rogelio A Mancisidor , Michael Kampffmeyer , Kjersti Aas , Robert Jenssen

Autoencoders are commonly trained using element-wise loss. However, element-wise loss disregards high-level structures in the image which can lead to embeddings that disregard them as well. A recent improvement to autoencoders that helps…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Gustav Grund Pihlgren , Fredrik Sandin , Marcus Liwicki

Sparse coding algorithm is an learning algorithm mainly for unsupervised feature for finding succinct, a little above high - level Representation of inputs, and it has successfully given a way for Deep learning. Our objective is to use High…

Machine Learning · Computer Science 2014-04-08 R. Vidya , Dr. G. M. Nasira , R. P. Jaia Priyankka

We propose a novel machine learning strategy for studying neuroanatomical shape variation. Our model works with volumetric binary segmentation images, and requires no pre-processing such as the extraction of surface points or a mesh. The…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Evan M. Yu , Mert R. Sabuncu

We implement stacked denoising autoencoders, a class of neural networks that are capable of learning powerful representations of high dimensional data. We describe stochastic gradient descent for unsupervised training of autoencoders, as…

Machine Learning · Computer Science 2021-02-17 Jason Liang , Keith Kelly

Most of the data-driven approaches applied to bearing fault diagnosis up to date are established in the supervised learning paradigm, which usually requires a large set of labeled data collected a priori. In practical applications, however,…

Machine Learning · Computer Science 2019-12-10 Shen Zhang , Fei Ye , Bingnan Wang , Thomas G. Habetler

We introduce a framework for unsupervised learning of structured predictors with overlapping, global features. Each input's latent representation is predicted conditional on the observable data using a feature-rich conditional random field.…

Machine Learning · Computer Science 2014-11-11 Waleed Ammar , Chris Dyer , Noah A. Smith

The predominant approach for language modeling is to process sequences from left to right, but this eliminates a source of information: the order by which the sequence was generated. One strategy to recover this information is to decode…

Computation and Language · Computer Science 2021-11-01 Xuanlin Li , Brandon Trabucco , Dong Huk Park , Michael Luo , Sheng Shen , Trevor Darrell , Yang Gao

By sampling from the latent space of an autoencoder and decoding the latent space samples to the original data space, any autoencoder can simply be turned into a generative model. For this to work, it is necessary to model the autoencoder's…

Machine Learning · Statistics 2023-09-19 Maximilian Coblenz , Oliver Grothe , Fabian Kächele

Recent efforts towards video anomaly detection (VAD) try to learn a deep autoencoder to describe normal event patterns with small reconstruction errors. The video inputs with large reconstruction errors are regarded as anomalies at the test…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yuandu Lai , Yahong Han , Yaowei Wang

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

Machine Learning · Statistics 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

Self-supervised representation learning solves auxiliary prediction tasks (known as pretext tasks) without requiring labeled data to learn useful semantic representations. These pretext tasks are created solely using the input features,…

Machine Learning · Computer Science 2021-11-16 Jason D. Lee , Qi Lei , Nikunj Saunshi , Jiacheng Zhuo