English
Related papers

Related papers: Bayesian High-dimensional Semi-parametric Inferenc…

200 papers

We consider nonparametric measurement error density deconvolution subject to heteroscedastic measurement errors as well as symmetry about zero and shape constraints, in particular unimodality. The problem is motivated by applications where…

Methodology · Statistics 2020-02-19 Ya Su , Anirban Bhattacharya , Yan Zhang , Nilanjan Chatterjee , Raymond J. Carroll

This work performs a non-asymptotic analysis of the generalized Lasso under the assumption of sub-exponential data. Our main results continue recent research on the benchmark case of (sub-)Gaussian sample distributions and thereby explore…

Statistics Theory · Mathematics 2023-01-18 Martin Genzel , Christian Kipp

This article is about estimation and inference methods for high dimensional sparse (HDS) regression models in econometrics. High dimensional sparse models arise in situations where many regressors (or series terms) are available and the…

Methodology · Statistics 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Christian Hansen

Score-based Generative Models (SGMs) approximate a data distribution by perturbing it with Gaussian noise and subsequently denoising it via a learned reverse diffusion process. These models excel at modeling complex data distributions and…

Machine Learning · Computer Science 2025-09-23 Stefano Bruno , Sotirios Sabanis

In this paper we compare and contrast the behavior of the posterior predictive distribution to the risk of the maximum a posteriori estimator for the random features regression model in the overparameterized regime. We will focus on the…

Machine Learning · Statistics 2023-10-30 Youngsoo Baek , Samuel I. Berchuck , Sayan Mukherjee

We characterise the convergence of the Gibbs sampler which samples from the joint posterior distribution of parameters and missing data in hierarchical linear models with arbitrary symmetric error distributions. We show that the convergence…

Methodology · Statistics 2007-10-24 Omiros Papaspiliopoulos , Gareth Roberts

We study a nonparametric Bayesian approach to linear inverse problems under discrete observations. We use the discrete Fourier transform to convert our model into a truncated Gaussian sequence model, that is closely related to the classical…

Statistics Theory · Mathematics 2018-10-31 Shota Gugushvili , Aad van der Vaart , Dong Yan

We investigate the high-dimensional linear regression problem in the presence of noise correlated with Gaussian covariates. This correlation, known as endogeneity in regression models, often arises from unobserved variables and other…

Statistics Theory · Mathematics 2023-10-23 Toshiki Tsuda , Masaaki Imaizumi

We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-Gaussian. We find…

Statistics Theory · Mathematics 2021-04-12 Arun K. Kuchibhotla , Rohit K. Patra

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

Methodology · Statistics 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

We derive posterior contraction rates (PCRs) and finite-sample Bernstein von Mises (BvM) results for non-parametric Bayesian models by extending the diffusion-based framework of Mou et al. (2024) to the infinite-dimensional setting. The…

Machine Learning · Statistics 2026-03-25 Enric Alberola-Boloix , Ioar Casado-Telletxea

Covariate measurement error in nonparametric regression is a common problem in nutritional epidemiology and geostatistics, and other fields. Over the last two decades, this problem has received substantial attention in the frequentist…

Statistics Theory · Mathematics 2023-01-27 Shuang Zhou , Debdeep Pati , Tianying Wang , Yun Yang , Raymond J. Carroll

The celebrated Bernstein von-Mises theorem ensures that credible regions from Bayesian posterior are well-calibrated when the model is correctly-specified, in the frequentist sense that their coverage probabilities tend to the nominal…

Methodology · Statistics 2021-09-17 Rong Tang , Yun Yang

Data dispersed across multiple files are commonly integrated through probabilistic linkage methods, where even minimal error rates in record matching can significantly contaminate subsequent statistical analyses. In regression problems, we…

Statistics Theory · Mathematics 2024-09-18 Abhisek Chakraborty , Saptati Datta

Semiparametric mixture models are parametric models with latent variables. They are defined kernel, $p_\theta(x | z)$, where z is the unknown latent variable, and $\theta$ is the parameter of interest. We assume that the latent variables…

Statistics Theory · Mathematics 2024-12-03 Stefan Franssen , Jeanne Nguyen , Aad van der Vaart

We explore various Bayesian approaches to estimate partial Gaussian graphical models. Our hierarchical structures enable to deal with single-output as well as multiple-output linear regressions, in small or high dimension, enforcing either…

Methodology · Statistics 2021-12-14 Eunice Okome Obiang , Pascal Jézéquel , Frédéric Proïa

We study the posterior distribution of the Bayesian multiple change-point regression problem when the number and the locations of the change-points are unknown. While it is relatively easy to apply the general theory to obtain the…

Statistics Theory · Mathematics 2008-08-21 Heng Lian

Missing values in datasets are common in applied statistics. For regression problems, theoretical work thus far has largely considered the issue of missing covariates as distinct from missing responses. However, in practice, many datasets…

Statistics Theory · Mathematics 2026-02-17 Benedict M. Risebrow , Thomas B. Berrett

We consider sparse Bayesian estimation in the classical multivariate linear regression model with $p$ regressors and $q$ response variables. In univariate Bayesian linear regression with a single response $y$, shrinkage priors which can be…

Methodology · Statistics 2018-05-21 Ray Bai , Malay Ghosh

In this manuscript a unified framework for conducting inference on complex aggregated data in high dimensional settings is proposed. The data are assumed to be a collection of multiple non-Gaussian realizations with underlying undirected…

Applications · Statistics 2013-10-14 Fang Han , Han Liu , Brian Caffo