English
Related papers

Related papers: Distributional Gaussian Process Layers for Outlier…

200 papers

We introduce a variational Bayesian neural network where the parameters are governed via a probability distribution on random matrices. Specifically, we employ a matrix variate Gaussian \cite{gupta1999matrix} parameter posterior…

Machine Learning · Statistics 2016-06-24 Christos Louizos , Max Welling

Accurate quantification of uncertainty in neural network predictions remains a central challenge for scientific applications involving high-dimensional, correlated data. While existing methods capture either aleatoric or epistemic…

Machine Learning · Computer Science 2025-08-26 Harrison J. Goldwyn , Mitchell Krock , Johann Rudi , Daniel Getter , Julie Bessac

Distribution data refers to a data set where each sample is represented as a probability distribution, a subject area receiving burgeoning interest in the field of statistics. Although several studies have developed…

Methodology · Statistics 2024-02-09 Ryo Okano , Masaaki Imaizumi

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

We propose deep convolutional Gaussian processes, a deep Gaussian process architecture with convolutional structure. The model is a principled Bayesian framework for detecting hierarchical combinations of local features for image…

Machine Learning · Computer Science 2018-10-09 Kenneth Blomqvist , Samuel Kaski , Markus Heinonen

Neural networks have revolutionized the field of machine learning with increased predictive capability. In addition to improving the predictions of neural networks, there is a simultaneous demand for reliable uncertainty quantification on…

Machine Learning · Computer Science 2023-08-10 Ethan Ancell , Christopher Bennett , Bert Debusschere , Sapan Agarwal , Park Hays , T. Patrick Xiao

We use neural networks to represent the characteristic function of many-body Gaussian states in the quantum phase space. By a pullback mechanism, we model transformations due to unitary operators as linear layers that can be cascaded to…

Quantum Physics · Physics 2021-10-19 Claudio Conti

It is a common assumption that the activation of different layers in neural networks follow Gaussian distribution. This distribution can be transformed using normalization techniques, such as batch-normalization, increasing convergence…

Machine Learning · Computer Science 2020-10-19 Andras Horvath , Jalal Al-afandi

A method to perform unfolding with Gaussian processes (GPs) is presented. Using Bayesian regression, we define an estimator for the underlying truth distribution as the mode of the posterior. We show that in the case where the bin contents…

Data Analysis, Statistics and Probability · Physics 2018-11-07 Adam Bozson , Glen Cowan , Francesco Spanò

Detecting out-of-distribution inputs for visual recognition models has become critical in safe deep learning. This paper proposes a novel hierarchical visual category modeling scheme to separate out-of-distribution data from in-distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jinglun Li , Xinyu Zhou , Pinxue Guo , Yixuan Sun , Yiwen Huang , Weifeng Ge , Wenqiang Zhang

Deep neural networks can obtain impressive performance on various tasks under the assumption that their training domain is identical to their target domain. Performance can drop dramatically when this assumption does not hold. One…

Machine Learning · Computer Science 2024-10-10 Gaël Gendron , Michael Witbrock , Gillian Dobbie

Gaussian processes allow for flexible specification of prior assumptions of unknown dynamics in state space models. We present a procedure for efficient Bayesian learning in Gaussian process state space models, where the representation is…

Computation · Statistics 2016-04-18 Andreas Svensson , Arno Solin , Simo Särkkä , Thomas B. Schön

Despite the strong predictive performance achieved by machine learning models across many application domains, assessing their trustworthiness through reliable estimates of predictive confidence remains a critical challenge. This issue…

Machine Learning · Computer Science 2026-03-25 Abolfazl Mohammadi-Seif , Carlos Soares , Rita P. Ribeiro , Ricardo Baeza-Yates

Understanding capabilities and limitations of different network architectures is of fundamental importance to machine learning. Bayesian inference on Gaussian processes has proven to be a viable approach for studying recurrent and deep…

Disordered Systems and Neural Networks · Physics 2022-10-17 Kai Segadlo , Bastian Epping , Alexander van Meegen , David Dahmen , Michael Krämer , Moritz Helias

We propose practical deep Gaussian process models on Riemannian manifolds, similar in spirit to residual neural networks. With manifold-to-manifold hidden layers and an arbitrary last layer, they can model manifold- and scalar-valued…

Machine Learning · Statistics 2025-03-03 Kacper Wyrwal , Andreas Krause , Viacheslav Borovitskiy

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Machine Learning · Computer Science 2021-08-02 Armin Lederer , Alejandro Jose Ordonez Conejo , Korbinian Maier , Wenxin Xiao , Jonas Umlauft , Sandra Hirche

We develop a framework for generalized variational inference in infinite-dimensional function spaces and use it to construct a method termed Gaussian Wasserstein inference (GWI). GWI leverages the Wasserstein distance between Gaussian…

Machine Learning · Statistics 2022-10-18 Veit D. Wild , Robert Hu , Dino Sejdinovic

Bayesian methods in machine learning, such as Gaussian processes, have great advantages com-pared to other techniques. In particular, they provide estimates of the uncertainty associated with a prediction. Extending the Bayesian approach to…

Quantum Physics · Physics 2019-05-20 Zhikuan Zhao , Alejandro Pozas-Kerstjens , Patrick Rebentrost , Peter Wittek

In this work, we investigate Gaussian Processes indexed by multidimensional distributions. While directly constructing radial positive definite kernels based on the Wasserstein distance has been proven to be possible in the unidimensional…

Bayesian estimation of Gaussian graphical models has proven to be challenging because the conjugate prior distribution on the Gaussian precision matrix, the G-Wishart distribution, has a doubly intractable partition function. Recent…

Neurons and Cognition · Quantitative Biology 2014-09-10 Max Hinne , Alex Lenkoski , Tom Heskes , Marcel van Gerven