中文
相关论文

相关论文: Active Learning for Gaussian Process Regression Un…

200 篇论文

Extrinsic Gaussian process regression methods, such as wrapped Gaussian process, have been developed to analyze manifold data. However, there is a lack of intrinsic Gaussian process methods for studying complex data with manifold-valued…

机器学习 · 统计学 2025-02-11 Zhanfeng Wang , Xinyu Li , Hao Ding , Jian Qing Shi

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

机器学习 · 计算机科学 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

We use the maximum a posteriori estimation principle for learning representations distributed on the unit sphere. We propose to use the angular Gaussian distribution, which corresponds to a Gaussian projected on the unit-sphere and derive…

机器学习 · 计算机科学 2024-02-19 Nicolas Michel , Giovanni Chierchia , Romain Negrel , Jean-François Bercher

Information-theoretic approaches to active learning have traditionally focused on maximising the information gathered about the model parameters, most commonly by optimising the BALD score. We highlight that this can be suboptimal from the…

机器学习 · 计算机科学 2023-04-18 Freddie Bickford Smith , Andreas Kirsch , Sebastian Farquhar , Yarin Gal , Adam Foster , Tom Rainforth

Compared to point estimates calculated by standard neural networks, Bayesian neural networks (BNN) provide probability distributions over the output predictions and model parameters, i.e., the weights. Training the weight distribution of a…

机器学习 · 计算机科学 2022-12-01 Philipp Wagner , Xinyang Wu , Marco F. Huber

Gaussian process regression (GPR) has been a well-known machine learning method for various applications such as uncertainty quantifications (UQ). However, GPR is inherently a data-driven method, which requires sufficiently large dataset.…

机器学习 · 计算机科学 2023-05-03 Cheng Chang , Tieyong Zeng

Stationary points embedded in the derivatives are often critical for a model to be interpretable and may be considered as key features of interest in many applications. We propose a semiparametric Bayesian model to efficiently infer the…

统计方法学 · 统计学 2024-06-11 Cheng-Han Yu , Meng Li , Colin Noe , Simon Fischer-Baum , Marina Vannucci

Considering a probability distribution over parameters is known as an efficient strategy to learn a neural network with non-differentiable activation functions. We study the expectation of a probabilistic neural network as a predictor by…

机器学习 · 计算机科学 2023-04-17 Louis Fortier-Dubois , Gaël Letarte , Benjamin Leblanc , François Laviolette , Pascal Germain

Reweighting a distribution to minimize a distance to a target distribution is a powerful and flexible strategy for estimating a wide range of causal effects, but can be challenging in practice because optimal weights typically depend on…

机器学习 · 统计学 2026-02-16 Oscar Clivio , Avi Feller , Chris Holmes

Learning in Gaussian Process models occurs through the adaptation of hyperparameters of the mean and the covariance function. The classical approach entails maximizing the marginal likelihood yielding fixed point estimates (an approach…

机器学习 · 统计学 2020-04-07 Vidhi Lalchand , Carl Edward Rasmussen

The binary perceptron is the simplest artificial neural network formed by $N$ input units and one output unit, with the neural states and the synaptic weights all restricted to $\pm 1$ values. The task in the teacher--student scenario is to…

机器学习 · 计算机科学 2019-03-15 Hai-Jun Zhou

Bayesian active learning is based on information theoretical approaches that focus on maximising the information that new observations provide to the model parameters. This is commonly done by maximising the Bayesian Active Learning by…

机器学习 · 计算机科学 2024-02-20 Frederik Boe Hüttel , Christoffer Riis , Filipe Rodrigues , Francisco Câmara Pereira

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

机器学习 · 统计学 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

We introduce a novel Bayesian approach for variable selection using Gaussian process regression, which is crucial for enhancing interpretability and model regularization. Our method employs nearest neighbor Gaussian processes, serving as…

We introduce a random partition model for Bayesian nonparametric regression. The model is based on infinitely-many disjoint regions of the range of a latent covariate-dependent Gaussian process. Given a realization of the process, the…

统计方法学 · 统计学 2013-01-04 George Karabatsos , Stephen G. Walker

Neutron scattering experiments at three-axes spectrometers (TAS) investigate magnetic and lattice excitations by measuring intensity distributions to understand the origins of materials properties. The high demand and limited availability…

数据分析、统计与概率 · 物理学 2023-04-24 Mario Teixeira Parente , Georg Brandl , Christian Franz , Uwe Stuhr , Marina Ganeva , Astrid Schneidewind

Active data acquisition is central to many learning and optimization tasks in deep neural networks, yet remains challenging because most approaches rely on predictive uncertainty estimates that are difficult to obtain reliably. To this end,…

机器学习 · 统计学 2026-02-24 Weichi Yao , Bianca Dumitrascu , Bryan R. Goldsmith , Yixin Wang

Predicated on the increasing abundance of electronic health records, we investi- gate the problem of inferring individualized treatment effects using observational data. Stemming from the potential outcomes model, we propose a novel multi-…

机器学习 · 计算机科学 2017-05-30 Ahmed M. Alaa , Mihaela van der Schaar

We study active structure learning of Bayesian networks in an observational setting, in which there are external limitations on the number of variable values that can be observed from the same sample. Random samples are drawn from the joint…

机器学习 · 计算机科学 2022-08-23 Noa Ben-David , Sivan Sabato

One of the primary goals of statistical precision medicine is to learn optimal individualized treatment rules (ITRs). The classification-based, or machine learning-based, approach to estimating optimal ITRs was first introduced in…

统计方法学 · 统计学 2024-06-18 Sophia Yazzourh , Nikki L. B. Freeman