English
Related papers

Related papers: Adaptive nonparametric Bayesian inference using lo…

200 papers

It is well-known that the high computational complexity and the insufficient samples in large-scale array signal processing restrict the real-world applications of the conventional full-dimensional adaptive beamforming (sample matrix…

Information Theory · Computer Science 2014-05-20 Hu Xie , Da-Zheng Feng , Ming-Dong Yuan

We consider Bayesian inference problems with computationally intensive likelihood functions. We propose a Gaussian process (GP) based method to approximate the joint distribution of the unknown parameters and the data. In particular, we…

Computation · Statistics 2018-03-15 Hongqiao Wang , Jinglai Li

In statistical applications, it is common to encounter parameters supported on a varying or unknown dimensional space. Examples include the fused lasso regression, the matrix recovery under an unknown low rank, etc. Despite the ease of…

Methodology · Statistics 2022-10-04 Maoran Xu , Hua Zhou , Yujie Hu , Leo L. Duan

We propose an adaptive scheme for distributed learning of nonlinear functions by a network of nodes. The proposed algorithm consists of a local adaptation stage utilizing multiple kernels with projections onto hyperslabs and a diffusion…

Signal Processing · Electrical Eng. & Systems 2018-09-05 Ban-Sok Shin , Masahiro Yukawa , Renato Luis Garrido Cavalcante , Armin Dekorsy

For exchangeable data, mixture models are an extremely useful tool for density estimation due to their attractive balance between smoothness and flexibility. When additional covariate information is present, mixture models can be extended…

Methodology · Statistics 2023-08-01 Sara Wade , Vanda Inacio , Sonia Petrone

Calibration of computer models is a key step in making inferences, predictions, and decisions for complex science and engineering systems. We formulate and analyze a nonparametric Bayesian methodology for computer model calibration. This…

Methodology · Statistics 2025-12-01 Haiyi Shi , Lei Yang , Jiarui Chi , Troy Butler , Haonan Wang , Derek Bingham , Don Estep

Unmanned aerial vehicles are rapidly gaining popularity in a variety of environmental monitoring tasks. A key requirement for their autonomous operation is the ability to perform efficient environmental mapping online, given limited onboard…

Robotics · Computer Science 2022-03-04 Liren Jin , Julius Rückin , Stefan H. Kiss , Teresa Vidal-Calleja , Marija Popović

In this paper, we present a comprehensive analysis of the posterior covariance field in Gaussian processes, with applications to the posterior covariance matrix. The analysis is based on the Gaussian prior covariance but the approach also…

Machine Learning · Statistics 2025-04-03 Difeng Cai , Edmond Chow , Yuanzhe Xi

For two vast families of mixture distributions and a given prior, we provide unified representations of posterior and predictive distributions. Model applications presented include bivariate mixtures of Gamma distributions labelled as…

Statistics Theory · Mathematics 2020-09-09 Aziz LMoudden , Éric Marchand

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach

We present a new adaptive method for electronic structure calculations based on novel fast algorithms for reduction of multivariate mixtures. In our calculations, spatial orbitals are maintained as Gaussian mixtures whose terms are selected…

Numerical Analysis · Mathematics 2019-06-19 Gregory Beylkin , Lucas Monzon , Xinshuo Yang

Nonparametric kernel density and local polynomial regression estimators are very popular in Statistics, Economics, and many other disciplines. They are routinely employed in applied work, either as part of the main empirical analysis or as…

Computation · Statistics 2020-07-21 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell

Bayesian hierarchical methods implemented for small area estimation focus on reducing the noise variation in published government official statistics by borrowing information among dependent response values. Even the most flexible models…

Methodology · Statistics 2015-08-05 Terrance D. Savitsky

Bayesian field theory denotes a nonparametric Bayesian approach for learning functions from observational data. Based on the principles of Bayesian statistics, a particular Bayesian field theory is defined by combining two models: a…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm

Bayesian inference is used extensively to infer and to quantify the uncertainty in a field of interest from a measurement of a related field when the two are linked by a physical model. Despite its many applications, Bayesian inference…

Machine Learning · Statistics 2019-07-24 Dhruv Patel , Assad A Oberai

Probabilistic regression techniques in control and robotics applications have to fulfill different criteria of data-driven adaptability, computational efficiency, scalability to high dimensions, and the capacity to deal with different…

Machine Learning · Computer Science 2021-03-31 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

We present a probabilistic framework for both (i) determining the initial settings of kernel adaptive filters (KAFs) and (ii) constructing fully-adaptive KAFs whereby in addition to weights and dictionaries, kernel parameters are learnt…

Machine Learning · Statistics 2017-07-21 Iván Castro , Cristóbal Silva , Felipe Tobar

We introduce a novel adaptive Gaussian Process Regression (GPR) methodology for efficient construction of surrogate models for Bayesian inverse problems with expensive forward model evaluations. An adaptive design strategy focuses on…

Numerical Analysis · Mathematics 2024-05-01 Paolo Villani , Jörg Unger , Martin Weiser

In Bayesian multilevel models, the data are structured in interconnected groups, and their posteriors borrow information from one another due to prior dependence between latent parameters. However, little is known about the behaviour of the…

Statistics Theory · Mathematics 2025-09-25 Marta Catalano , Hugo Lavenant , Francesco Mascari