English
Related papers

Related papers: Bayesian Inference on Multivariate Medians and Qua…

200 papers

Compared to mean regression and quantile regression, the literature on modal regression is very sparse. A unifying framework for Bayesian modal regression is proposed, based on a family of unimodal distributions indexed by the mode, along…

Methodology · Statistics 2024-07-02 Qingyang Liu , Xianzheng Huang , Rai Bai

The sample mean is often used to aggregate different unbiased estimates of a parameter, producing a final estimate that is unbiased but possibly high-variance. This paper introduces the Bayesian median of means, an aggregation rule that…

Statistics Theory · Mathematics 2019-06-05 Paulo Orenstein

Bayesian inference typically requires the computation of an approximation to the posterior distribution. An important requirement for an approximate Bayesian inference algorithm is to output high-accuracy posterior mean and uncertainty…

Statistics Theory · Mathematics 2018-10-03 Jonathan H. Huggins , Trevor Campbell , Mikołaj Kasprzak , Tamara Broderick

In this paper we provide general conditions to check on the model and the prior to derive posterior concentration rates for data-dependent priors (or empirical Bayes approaches). We aim at providing conditions that are close to the…

Statistics Theory · Mathematics 2014-06-18 Sophie Donnet , Vincent Rivoirard , Judith Rousseau , Catia Scricciolo

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

An important task in the statistical analysis of inhomogeneous point processes is to investigate the influence of a set of covariates on the point-generating mechanism. In this article, we consider the nonparametric Bayesian approach to…

Methodology · Statistics 2026-01-19 Patric Dolmeta , Matteo Giordano

In his 1986 book, Aitchison explains that compositional data is regularly mishandled in statistical analyses, a pattern that continues to this day. The Dirichlet Type I distribution is a multivariate distribution commonly used to model a…

Statistics Theory · Mathematics 2018-04-06 Sean van der Merwe , Daan de Waal

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

We consider the problem of drawing samples from posterior distributions formed under a Dirichlet prior and a truncated multinomial likelihood, by which we mean a Multinomial likelihood function where we condition on one or more counts being…

Methodology · Statistics 2012-09-04 Matthew James Johnson , Alan S. Willsky

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

Machine Learning · Statistics 2025-01-22 Katharine Fisher , Youssef Marzouk

In this paper, we consider objective Bayesian inference of the generalized exponential distribution using the independence Jeffreys prior and validate the propriety of the posterior distribution under a family of structured priors. We…

Methodology · Statistics 2023-09-26 Aojun Li , Keying Ye , Min Wang

Bayesian neural networks (BNNs) combine the expressive power of deep learning with the advantages of Bayesian formalism. In recent years, the analysis of wide, deep BNNs has provided theoretical insight into their priors and posteriors.…

Machine Learning · Computer Science 2022-02-24 Beau Coker , Wessel P. Bruinsma , David R. Burt , Weiwei Pan , Finale Doshi-Velez

The methodology developed in this article is motivated by a wide range of prediction and uncertainty quantification problems that arise in Statistics, Machine Learning and Applied Mathematics, such as non-parametric regression, multi-class…

Methodology · Statistics 2019-03-26 Victor Chen , Matthew M. Dunlop , Omiros Papaspiliopoulos , Andrew M. Stuart

The analytic inference, e.g. predictive distribution being in closed form, may be an appealing benefit for machine learning practitioners when they treat wide neural networks as Gaussian process in Bayesian setting. The realistic widths,…

Disordered Systems and Neural Networks · Physics 2023-08-01 Chi-Ken Lu

We consider a sparse linear regression model with unknown symmetric error under the high-dimensional setting. The true error distribution is assumed to belong to the locally $\beta$-H\"{o}lder class with an exponentially decreasing tail,…

Statistics Theory · Mathematics 2020-09-01 Kyoungjae Lee , Minwoo Chae , Lizhen Lin

Quantile regression is often used when a comprehensive relationship between a response variable and one or more explanatory variables is desired. The traditional frequentists' approach to quantile regression has been well developed around…

Statistics Theory · Mathematics 2015-06-03 Yang Feng , Yuguo Chen , Xuming He

The classical mixture of Gaussians model is related to K-means via small-variance asymptotics: as the covariances of the Gaussians tend to zero, the negative log-likelihood of the mixture of Gaussians model approaches the K-means objective,…

Machine Learning · Statistics 2013-02-19 Tamara Broderick , Brian Kulis , Michael I. Jordan

I propose a semiparametric Bayesian inference framework for conditional moment equalities. The core idea is that these models deterministically map a conditional distribution of data to a structural parameter via the restriction that a…

Econometrics · Economics 2026-03-19 Christopher D. Walker

The bivariate normal density with unit variance and correlation $\rho$ is well-known. We show that by integrating out $\rho$, the result is a function of the maximum norm. The Bayesian interpretation of this result is that if we put a…

Statistics Theory · Mathematics 2015-11-20 Kai Zhang , Lawrence D. Brown , Edward George , Linda Zhao

We present a nonparametric Bayesian joint model for multivariate continuous and categorical variables, with the intention of developing a flexible engine for multiple imputation of missing values. The model fuses Dirichlet process mixtures…

Applications · Statistics 2015-10-14 Jared S. Murray , Jerome P. Reiter