English
Related papers

Related papers: Posterior contraction rates in a sparse non-linear…

200 papers

Mixed-effect models are very popular for analyzing data with a hierarchical structure, e.g. repeated observations within subjects in a longitudinal design, patients nested within centers in a multicenter design. However, recently, due to…

Methodology · Statistics 2019-05-09 Abhik Ghosh , Magne Thoresen

Mixtures of linear mixed models are widely used for modelling longitudinal data for which observation times differ between subjects. In typical applications, temporal trends are described using a basis expansion, with basis coefficients…

Methodology · Statistics 2025-11-25 Lucas Kock , Nadja Klein , David J. Nott

This paper studies the sparse normal mean models under the empirical Bayes framework. We focus on the mixture priors with an atom at zero and a density component centered at a data driven location determined by maximizing the marginal…

Methodology · Statistics 2017-02-20 Xianyang Zhang , Anirban Bhattacharya

The prominent Bernstein -- von Mises (BvM) result claims that the posterior distribution after centering by the efficient estimator and standardizing by the square root of the total Fisher information is nearly standard normal. In…

Statistics Theory · Mathematics 2020-06-02 Vladimir Spokoiny , Maxim Panov

The analysis of data from multiple experiments, such as observations of several individuals, is commonly approached using mixed-effects models, which account for variation between individuals through hierarchical representations. This makes…

Computation · Statistics 2026-03-05 Henrik Häggström , Sebastian Persson , Marija Cvijovic , Umberto Picchini

In a meta-analysis, it is important to specify a model that adequately describes the effect-size distribution of the underlying population of studies. The conventional normal fixed-effect and normal random-effects models assume a normal…

Methodology · Statistics 2013-10-21 George Karabatsos , Elizabeth Talbott , Stephen G. Walker

Spatial Gaussian process regression models typically contain finite dimensional covariance parameters that need to be estimated from the data. We study the Bayesian estimation of covariance parameters including the nugget parameter in a…

Statistics Theory · Mathematics 2023-02-22 Cheng Li , Saifei Sun , Yichen Zhu

We investigate the frequentist guarantees of the variational sparse Gaussian process regression model. In the theoretical analysis, we focus on the variational approach with spectral features as inducing variables. We derive guarantees and…

Statistics Theory · Mathematics 2023-09-29 Dennis Nieman , Botond Szabo , Harry van Zanten

This study extends the Bayesian nonparametric instrumental variable regression model to determine the structural effects of covariates on the conditional quantile of the response variable. The error distribution is nonparametrically…

Methodology · Statistics 2016-08-30 Genya Kobayashi , Kota Ogasawara

We study posterior rates of contraction in Gaussian process regression with unbounded covariate domain. Our argument relies on developing a Gaussian approximation to the posterior of the leading coefficients of a Karhunen--Lo\'{e}ve…

Statistics Theory · Mathematics 2015-10-06 Anirban Bhattacharya , Debdeep Pati

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

Machine Learning · Statistics 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

The nested error regression model is a useful tool for analyzing clustered (grouped) data, and is especially used in small area estimation. The classical nested error regression model assumes normality of random effects and error terms, and…

Methodology · Statistics 2016-05-16 Shonosuke Sugasawa , Tatsuya Kubokawa

We introduce a framework for estimating causal effects of binary and continuous treatments in high dimensions. We show how posterior distributions of treatment and outcome models can be used together with doubly robust estimators. We…

Methodology · Statistics 2020-10-06 Joseph Antonelli , Georgia Papadogeorgou , Francesca Dominici

We consider a general nonparametric regression model called the compound model. It includes, as special cases, sparse additive regression and nonparametric (or linear) regression with many covariates but possibly a small number of relevant…

Statistics Theory · Mathematics 2013-01-04 Arnak Dalalyan , Yuri Ingster , Alexandre Tsybakov

We study a nonparametric Bayesian approach to linear inverse problems under discrete observations. We use the discrete Fourier transform to convert our model into a truncated Gaussian sequence model, that is closely related to the classical…

Statistics Theory · Mathematics 2018-10-31 Shota Gugushvili , Aad van der Vaart , Dong Yan

We study the theoretical properties of a variational Bayes method in the Gaussian Process regression model. We consider the inducing variables method introduced by Titsias (2009a) and derive sufficient conditions for obtaining contraction…

Statistics Theory · Mathematics 2026-01-28 Dennis Nieman , Botond Szabo , Harry van Zanten

This paper builds on recent research that focuses on regression modeling of continuous bounded data, such as proportions measured on a continuous scale. Specifically, it deals with beta regression models with mixed effects from a Bayesian…

We consider Bayesian variable selection in sparse high-dimensional regression, where the number of covariates $p$ may be large relative to the samples size $n$, but at most a moderate number $q$ of covariates are active. Specifically, we…

Statistics Theory · Mathematics 2015-03-31 Rina Foygel Barber , Mathias Drton , Kean Ming Tan

We derive the posteror contraction rate for non-parametric Bayesian estimation of a deterministic dispersion coefficient of a linear stochastic differential equation.

Statistics Theory · Mathematics 2018-04-17 Shota Gugushvili , Peter Spreij

Bayesian predictive inference provides a coherent description of entire predictive uncertainty through predictive distributions. We examine several widely used sparsity priors from the predictive (as opposed to estimation) inference…

Statistics Theory · Mathematics 2024-06-03 Veronika Rockova