English
Related papers

Related papers: Active Learning for Gaussian Process Regression Un…

200 papers

Extrinsic Gaussian process regression methods, such as wrapped Gaussian process, have been developed to analyze manifold data. However, there is a lack of intrinsic Gaussian process methods for studying complex data with manifold-valued…

Machine Learning · Statistics 2025-02-11 Zhanfeng Wang , Xinyu Li , Hao Ding , Jian Qing Shi

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

Machine Learning · Computer Science 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

We use the maximum a posteriori estimation principle for learning representations distributed on the unit sphere. We propose to use the angular Gaussian distribution, which corresponds to a Gaussian projected on the unit-sphere and derive…

Machine Learning · Computer Science 2024-02-19 Nicolas Michel , Giovanni Chierchia , Romain Negrel , Jean-François Bercher

Information-theoretic approaches to active learning have traditionally focused on maximising the information gathered about the model parameters, most commonly by optimising the BALD score. We highlight that this can be suboptimal from the…

Machine Learning · Computer Science 2023-04-18 Freddie Bickford Smith , Andreas Kirsch , Sebastian Farquhar , Yarin Gal , Adam Foster , Tom Rainforth

Compared to point estimates calculated by standard neural networks, Bayesian neural networks (BNN) provide probability distributions over the output predictions and model parameters, i.e., the weights. Training the weight distribution of a…

Machine Learning · Computer Science 2022-12-01 Philipp Wagner , Xinyang Wu , Marco F. Huber

Gaussian process regression (GPR) has been a well-known machine learning method for various applications such as uncertainty quantifications (UQ). However, GPR is inherently a data-driven method, which requires sufficiently large dataset.…

Machine Learning · Computer Science 2023-05-03 Cheng Chang , Tieyong Zeng

Stationary points embedded in the derivatives are often critical for a model to be interpretable and may be considered as key features of interest in many applications. We propose a semiparametric Bayesian model to efficiently infer the…

Methodology · Statistics 2024-06-11 Cheng-Han Yu , Meng Li , Colin Noe , Simon Fischer-Baum , Marina Vannucci

Considering a probability distribution over parameters is known as an efficient strategy to learn a neural network with non-differentiable activation functions. We study the expectation of a probabilistic neural network as a predictor by…

Machine Learning · Computer Science 2023-04-17 Louis Fortier-Dubois , Gaël Letarte , Benjamin Leblanc , François Laviolette , Pascal Germain

Reweighting a distribution to minimize a distance to a target distribution is a powerful and flexible strategy for estimating a wide range of causal effects, but can be challenging in practice because optimal weights typically depend on…

Machine Learning · Statistics 2026-02-16 Oscar Clivio , Avi Feller , Chris Holmes

Learning in Gaussian Process models occurs through the adaptation of hyperparameters of the mean and the covariance function. The classical approach entails maximizing the marginal likelihood yielding fixed point estimates (an approach…

Machine Learning · Statistics 2020-04-07 Vidhi Lalchand , Carl Edward Rasmussen

The binary perceptron is the simplest artificial neural network formed by $N$ input units and one output unit, with the neural states and the synaptic weights all restricted to $\pm 1$ values. The task in the teacher--student scenario is to…

Machine Learning · Computer Science 2019-03-15 Hai-Jun Zhou

Bayesian active learning is based on information theoretical approaches that focus on maximising the information that new observations provide to the model parameters. This is commonly done by maximising the Bayesian Active Learning by…

Machine Learning · Computer Science 2024-02-20 Frederik Boe Hüttel , Christoffer Riis , Filipe Rodrigues , Francisco Câmara Pereira

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

We introduce a novel Bayesian approach for variable selection using Gaussian process regression, which is crucial for enhancing interpretability and model regularization. Our method employs nearest neighbor Gaussian processes, serving as…

We introduce a random partition model for Bayesian nonparametric regression. The model is based on infinitely-many disjoint regions of the range of a latent covariate-dependent Gaussian process. Given a realization of the process, the…

Methodology · Statistics 2013-01-04 George Karabatsos , Stephen G. Walker

Neutron scattering experiments at three-axes spectrometers (TAS) investigate magnetic and lattice excitations by measuring intensity distributions to understand the origins of materials properties. The high demand and limited availability…

Data Analysis, Statistics and Probability · Physics 2023-04-24 Mario Teixeira Parente , Georg Brandl , Christian Franz , Uwe Stuhr , Marina Ganeva , Astrid Schneidewind

Active data acquisition is central to many learning and optimization tasks in deep neural networks, yet remains challenging because most approaches rely on predictive uncertainty estimates that are difficult to obtain reliably. To this end,…

Machine Learning · Statistics 2026-02-24 Weichi Yao , Bianca Dumitrascu , Bryan R. Goldsmith , Yixin Wang

Predicated on the increasing abundance of electronic health records, we investi- gate the problem of inferring individualized treatment effects using observational data. Stemming from the potential outcomes model, we propose a novel multi-…

Machine Learning · Computer Science 2017-05-30 Ahmed M. Alaa , Mihaela van der Schaar

We study active structure learning of Bayesian networks in an observational setting, in which there are external limitations on the number of variable values that can be observed from the same sample. Random samples are drawn from the joint…

Machine Learning · Computer Science 2022-08-23 Noa Ben-David , Sivan Sabato

One of the primary goals of statistical precision medicine is to learn optimal individualized treatment rules (ITRs). The classification-based, or machine learning-based, approach to estimating optimal ITRs was first introduced in…

Methodology · Statistics 2024-06-18 Sophia Yazzourh , Nikki L. B. Freeman