English
Related papers

Related papers: Laplacian Autoencoders for Learning Stochastic Rep…

200 papers

Large neural networks trained on large datasets have become the dominant paradigm in machine learning. These systems rely on maximum likelihood point estimates of their parameters, precluding them from expressing model uncertainty. This may…

Machine Learning · Statistics 2024-05-01 Javier Antoran

The ability to learn good representations of states is essential for solving large reinforcement learning problems, where exploration, generalization, and transfer are particularly challenging. The Laplacian representation is a promising…

Machine Learning · Computer Science 2024-04-04 Diego Gomez , Michael Bowling , Marlos C. Machado

Optimization in the latent space of variational autoencoders is a promising approach to generate high-dimensional discrete objects that maximize an expensive black-box property (e.g., drug-likeness in molecular generation, function…

Machine Learning · Computer Science 2021-07-02 Pascal Notin , José Miguel Hernández-Lobato , Yarin Gal

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

Machine Learning · Computer Science 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

We implement stacked denoising autoencoders, a class of neural networks that are capable of learning powerful representations of high dimensional data. We describe stochastic gradient descent for unsupervised training of autoencoders, as…

Machine Learning · Computer Science 2021-02-17 Jason Liang , Keith Kelly

We propose a data-driven technique to automatically learn contextual uncertainty sets in robust optimization, resulting in excellent worst-case and average-case performance while also guaranteeing constraint satisfaction. Our method…

Optimization and Control · Mathematics 2025-06-25 Irina Wang , Bart Van Parys , Bartolomeo Stellato

The reliability assessment of a machine learning model's prediction is an important quantity for the deployment in safety critical applications. Not only can it be used to detect novel sceneries, either as out-of-distribution or anomaly…

Machine Learning · Computer Science 2022-05-12 Steve Dias Da Cruz , Bertram Taetz , Thomas Stifter , Didier Stricker

Unsupervised learning has been widely applied to various tasks in particle physics. However, existing models lack precise control over their learned representations, limiting physical interpretability and hindering their use for accurate…

High Energy Physics - Experiment · Physics 2025-12-01 Xing-Jian Lv , De-Xing Miao , Zi-Jun Xu , Jian-Chun Wang

Data augmentation is commonly applied to improve performance of deep learning by enforcing the knowledge that certain transformations on the input preserve the output. Currently, the data augmentation parameters are chosen by human effort…

We view variational autoencoders (VAE) as decoder-encoder pairs, which map distributions in the data space to distributions in the latent space and vice versa. The standard learning approach for VAEs is the maximisation of the evidence…

Machine Learning · Computer Science 2024-03-13 Boris Flach , Dmitrij Schlesinger , Alexander Shekhovtsov

The problem of estimating event truths from conflicting agent opinions in a social network is investigated. An autoencoder learns the complex relationships between event truths, agent reliabilities and agent observations. A Bayesian network…

Machine Learning · Computer Science 2021-01-26 Jielong Yang , Wee Peng Tay

We propose a new family of optimization criteria for variational auto-encoding models, generalizing the standard evidence lower bound. We provide conditions under which they recover the data distribution and learn latent features, and…

Machine Learning · Computer Science 2017-03-01 Shengjia Zhao , Jiaming Song , Stefano Ermon

Recent deep learning approaches focus on improving quantitative scores of dedicated benchmarks, and therefore only reduce the observation-related (aleatoric) uncertainty. However, the model-immanent (epistemic) uncertainty is less…

Image and Video Processing · Electrical Eng. & Systems 2021-10-25 Dominik Narnhofer , Alexander Effland , Erich Kobler , Kerstin Hammernik , Florian Knoll , Thomas Pock

Machine learning models provide statistically impressive results which might be individually unreliable. To provide reliability, we propose an Epistemic Classifier (EC) that can provide justification of its belief using support from the…

Machine Learning · Computer Science 2020-10-20 Chitresh Bhushan , Zhaoyuan Yang , Nurali Virani , Naresh Iyer

We propose the use of Bayesian networks, which provide both a mean value and an uncertainty estimate as output, to enhance the safety of learned control policies under circumstances in which a test-time input differs significantly from the…

Machine Learning · Computer Science 2019-02-18 Keuntaek Lee , Kamil Saigol , Evangelos A. Theodorou

Latent Gaussian models have a rich history in statistics and machine learning, with applications ranging from factor analysis to compressed sensing to time series analysis. The classical method for maximizing the likelihood of these models…

Machine Learning · Computer Science 2023-06-07 Alexander Lin , Bahareh Tolooshams , Yves Atchadé , Demba Ba

We propose a Bayesian elastic net that uses empirical likelihood and develop an efficient tuning of Hamiltonian Monte Carlo for posterior sampling. The proposed model relaxes the assumptions on the identity of the error distribution,…

Methodology · Statistics 2022-07-20 Chul Moon , Adel Bedoui

Being able to reliably assess not only the \emph{accuracy} but also the \emph{uncertainty} of models' predictions is an important endeavour in modern machine learning. Even if the model generating the data and labels is known, computing the…

Machine Learning · Computer Science 2023-09-12 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

Variational Autoencoders and their many variants have displayed impressive ability to perform dimensionality reduction, often achieving state-of-the-art performance. Many current methods however, struggle to learn good representations in…

Machine Learning · Computer Science 2023-06-28 Navindu Leelarathna , Andrei Margeloiu , Mateja Jamnik , Nikola Simidjievski

Bayesian meta-learning enables robust and fast adaptation to new tasks with uncertainty assessment. The key idea behind Bayesian meta-learning is empirical Bayes inference of hierarchical model. In this work, we extend this framework to…

Machine Learning · Computer Science 2020-11-19 Yayi Zou , Xiaoqi Lu