English
Related papers

Related papers: Learning Low-Rank Latent Spaces with Simple Determ…

200 papers

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

Unsupervised learning is of growing interest because it unlocks the potential held in vast amounts of unlabelled data to learn useful representations for inference. Autoencoders, a form of generative model, may be trained by learning to…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Antonia Creswell , Anil Anthony Bharath

Autoencoders, which consist of an encoder and a decoder, are widely used in machine learning for dimension reduction of high-dimensional data. The encoder embeds the input data manifold into a lower-dimensional latent space, while the…

Numerical Analysis · Mathematics 2024-03-29 Juliane Braunsmann , Marko Rajković , Martin Rumpf , Benedikt Wirth

Dimension Estimation (DE) and Dimension Reduction (DR) are two closely related topics, but with quite different goals. In DE, one attempts to estimate the intrinsic dimensionality or number of latent variables in a set of measurements of a…

Machine Learning · Computer Science 2019-09-25 Nitish Bahadur , Randy Paffenroth

Domain adaptation refers to the process of learning prediction models in a target domain by making use of data from a source domain. Many classic methods solve the domain adaptation problem by establishing a common latent space, which may…

Machine Learning · Computer Science 2018-08-21 Pan Xiao , Bo Du , Jia Wu , Lefei Zhang , Ruimin Hu , Xuelong Li

Regularized autoencoders learn the latent codes, a structure with the regularization under the distribution, which enables them the capability to infer the latent codes given observations and generate new samples given the codes. However,…

Machine Learning · Computer Science 2019-02-18 Wenju Xu , Shawn Keshmiri , Guanghui Wang

Autoencoders receive latent models of input data. It was shown in recent works that they also estimate probability density functions of the input. This fact makes using the Bayesian decision theory possible. If we obtain latent models of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Vasily Morzhakov

Is there really much more to say about sparse autoencoders (SAEs)? Autoencoders in general, and SAEs in particular, represent deep architectures that are capable of modeling low-dimensional latent structure in data. Such structure could…

Machine Learning · Computer Science 2025-06-09 Yin Lu , Xuening Zhu , Tong He , David Wipf

Autoencoders are a type of unsupervised neural networks, which can be used to solve various tasks, e.g., dimensionality reduction, image compression, and image denoising. An AE has two goals: (i) compress the original input to a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Firas Laakom , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

Autoencoders enable data dimensionality reduction and a key component of many (deep) learning systems. This short paper introduces a form of Holland's Learning Classifier System (LCS) to perform autoencoding building upon a previously…

Neural and Evolutionary Computing · Computer Science 2019-07-30 Larry Bull

The application of convolutional autoencoder deep learning to imaging data for planetary science and astrobiological use is briefly reviewed and explored with a focus on the need to understand algorithmic rationale, process, and results…

Earth and Planetary Astrophysics · Physics 2025-07-16 Caleb Scharf

Deep linear networks trained with gradient descent yield low rank solutions, as is typically studied in matrix factorization. In this paper, we take a step further and analyze implicit rank regularization in autoencoders. We show greedy…

Machine Learning · Computer Science 2021-07-06 Shih-Yu Sun , Vimal Thilak , Etai Littwin , Omid Saremi , Joshua M. Susskind

We tackle the problem disentangling the latent space of an autoencoder in order to separate labelled attribute information from other characteristic information. This then allows us to change selected attributes while preserving other…

Machine Learning · Computer Science 2020-08-18 Xiao Li , Chenghua Lin , Ruizhe Li , Chaozheng Wang , Frank Guerin

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Machine Learning · Computer Science 2017-03-07 Xi Chen , Diederik P. Kingma , Tim Salimans , Yan Duan , Prafulla Dhariwal , John Schulman , Ilya Sutskever , Pieter Abbeel

Wireless signal strength based localization can enable robust localization for robots using inexpensive sensors. For this, a location-to-signal-strength map has to be learned for each access point in the environment. Due to the ubiquity of…

Signal Processing · Electrical Eng. & Systems 2020-10-30 Renato Miyagusuku , Koichi Ozaki

Visualization is a crucial step in exploratory data analysis. One possible approach is to train an autoencoder with low-dimensional latent space. Large network depth and width can help unfolding the data. However, such expressive networks…

Machine Learning · Computer Science 2023-07-03 Philipp Nazari , Sebastian Damrich , Fred A. Hamprecht

Learning useful representations of complex data has been the subject of extensive research for many years. With the diffusion of Deep Neural Networks, Variational Autoencoders have gained lots of attention since they provide an explicit…

Machine Learning · Computer Science 2020-09-15 Marco Maggipinto , Matteo Terzi , Gian Antonio Susto

Formal verification provides a powerful framework for proving that dynamical systems satisfy their specifications. However, these techniques face scalability challenges in high-dimensional settings, as they often rely on state-space…

Machine Learning · Computer Science 2026-05-21 Robert Reed , Luca Laurenti , Morteza Lahijanian

Recent advances in the field of generative models and in particular generative adversarial networks (GANs) have lead to substantial progress for controlled image editing, especially compared with the pre-deep learning era. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Gwilherm Lesné , Yann Gousseau , Saïd Ladjal , Alasdair Newson

Audio autoencoders learn useful, compressed audio representations, but their non-linear latent spaces prevent intuitive algebraic manipulation such as mixing or scaling. We introduce a simple training methodology to induce linearity in a…

Sound · Computer Science 2026-01-29 Bernardo Torres , Manuel Moussallam , Gabriel Meseguer-Brocal