English
Related papers

Related papers: Nonparametric Bayesian Aggregation for Massive Dat…

200 papers

Computing size and credibility of Bayesian credible regions for certifying the reliability of any point estimator of an unknown parameter (such as a quantum state, channel, phase, \emph{etc.}) relies on rejection sampling from the entire…

Quantum Physics · Physics 2019-07-31 C. Oh , Y. S. Teo , H. Jeong

This chapter provides a overview of Bayesian inference, mostly emphasising that it is a universal method for summarising uncertainty and making estimates and predictions using probability statements conditional on observed data and an…

Methodology · Statistics 2010-02-11 Christian P. Robert , Jean-Michel Marin , Judith Rousseau

The aim of this paper is to provide some theoretical understanding of quasi-Bayesian aggregation methods non-negative matrix factorization. We derive an oracle inequality for an aggregated estimator. This result holds for a very general…

Machine Learning · Statistics 2018-06-27 Pierre Alquier , Benjamin Guedj

As inductive inference and machine learning methods in computer science see continued success, researchers are aiming to describe ever more complex probabilistic models and inference algorithms. It is natural to ask whether there is a…

Logic · Mathematics 2019-11-19 Nathanael L. Ackerman , Cameron E. Freer , Daniel M. Roy

Bayesian statistics is an integral part of contemporary applied science. bayesics provides a single framework, unified in syntax and output, for performing the most commonly used statistical procedures, ranging from one- and two-sample…

Methodology · Statistics 2026-02-18 Daniel K. Sewell , Alan T. Arakkal

A general challenge in statistics is prediction in the presence of multiple candidate models or learning algorithms. Model aggregation tries to combine all predictive distributions from individual models, which is more stable and flexible…

Methodology · Statistics 2021-09-28 Yuling Yao

Bayesian inference is used to estimate continuous parameter values given measured data in many fields of science. The method relies on conditional probability densities to describe information about both data and parameters, yet the notion…

Methodology · Statistics 2025-03-25 Klaus Mosegaard , Andrew Curtis

Graphs are ubiquitous in modelling relational structures. Recent endeavours in machine learning for graph-structured data have led to many architectures and learning algorithms. However, the graph used by these algorithms is often…

Machine Learning · Statistics 2020-06-25 Soumyasundar Pal , Saber Malekmohammadi , Florence Regol , Yingxue Zhang , Yishi Xu , Mark Coates

Given i.i.d. data from an unknown distribution, we consider the problem of predicting future items. An adaptive way to estimate the probability density is to recursively subdivide the domain to an appropriate data-dependent granularity. A…

Probability · Mathematics 2009-12-30 Marcus Hutter

Datasets are growing not just in size but in complexity, creating a demand for rich models and quantification of uncertainty. Bayesian methods are an excellent fit for this demand, but scaling Bayesian inference is a challenge. In response…

Machine Learning · Statistics 2016-03-23 Elaine Angelino , Matthew James Johnson , Ryan P. Adams

Nonparametric density estimation is an unsupervised learning problem. In this work we propose a two-step procedure that casts the density estimation problem in the first step into a supervised regression problem. The advantage is that we…

Statistics Theory · Mathematics 2024-06-04 Thijs Bos , Johannes Schmidt-Hieber

In a general class of Bayesian nonparametric models, we prove that the posterior distribution can be asymptotically approximated by a Gaussian process. Our results apply to nonparametric exponential family that contains both Gaussian and…

Statistics Theory · Mathematics 2017-11-01 Zuofeng Shang , Guang Cheng

In this article, we investigate large sample properties of model selection procedures in a general Bayesian framework when a closed form expression of the marginal likelihood function is not available or a local asymptotic quadratic…

Statistics Theory · Mathematics 2017-01-10 Yun Yang , Debdeep Pati

Aggregating estimators using exponential weights depending on their risk appears optimal in expectation but not in probability. We use here a slight overpenalization to obtain oracle inequality in probability for such an explicit…

Statistics Theory · Mathematics 2018-02-01 Lucie Montuelle , Erwan Le Pennec

We present a new approach to semiparametric inference using corrected posterior distributions. The method allows us to leverage the adaptivity, regularization and predictive power of nonparametric Bayesian procedures to estimate…

Methodology · Statistics 2023-06-21 Andrew Yiu , Edwin Fong , Chris Holmes , Judith Rousseau

We propose a Bayesian nonparametric (BNP) approach to causal inference using observational data consisting of outcome, treatment, and a set of confounders. The conditional distribution of the outcome given treatment and confounders is…

Methodology · Statistics 2025-12-01 Yongseok Hur , Joonhyuk Jung , Juhee Lee

A fully Bayesian approach is proposed for ultrahigh-dimensional nonparametric additive models in which the number of additive components may be larger than the sample size, though ideally the true model is believed to include only a small…

Methodology · Statistics 2013-09-24 Zuofeng Shang , Ping Li

This invited paper proposes and discusses several Bayesian attempts at nonparametric and semiparametric density estimation. The main categories of these ideas are as follows: 1) Build a nonparametric prior around a given parametric model.…

Statistics Theory · Mathematics 2026-04-23 Nils Lid Hjort

We consider the problem of inference for the states and parameters of a continuous-time multitype branching process from partially observed time series data. Exact inference for this class of models, typically using sequential Monte Carlo,…

Methodology · Statistics 2025-12-01 Angus Lewis , Antonio Parrella , John Maclean , Andrew J. Black

Given i.i.d. data from an unknown distribution, we consider the problem of predicting future items. An adaptive way to estimate the probability density is to recursively subdivide the domain to an appropriate data-dependent granularity. A…

Statistics Theory · Mathematics 2007-06-13 Marcus Hutter