English
Related papers

Related papers: Spike-and-Slab Posterior Sampling in High Dimensio…

200 papers

Discrete Bayesian nonparametric models whose expectation is a convex linear combination of a point mass at some point of the support and a diffuse probability distribution allow to incorporate strong prior information, while still being…

Statistics Theory · Mathematics 2021-07-22 Antonio Canale , Antonio Lijoi , Bernardo Nipoti , Igor Prünster

We study frequentist properties of a Bayesian high-dimensional multivariate linear regression model with correlated responses. The predictors are separated into many groups and the group structure is pre-determined. Two features of the…

Statistics Theory · Mathematics 2019-06-13 Bo Ning , Seonghyun Jeong , Subhashis Ghosal

In recent years, shrinkage priors have received much attention in high-dimensional data analysis from a Bayesian perspective. Compared with widely used spike-and-slab priors, shrinkage priors have better computational efficiency. But the…

Statistics Theory · Mathematics 2020-01-16 Ruoyang Zhang , Malay Ghosh

Identifying the parameters of a non-linear model that best explain observed data is a core task across scientific fields. When such models rely on complex simulators, evaluating the likelihood is typically intractable, making traditional…

In the first part of the series papers, we set out to answer the following question: given specific restrictions on a set of samplers, what kind of signal can be uniquely represented by the corresponding samples attained, as the foundation…

Information Theory · Computer Science 2021-08-25 Hanshen Xiao , Yaowen Zhang , Guoqiang Xiao

We study the problem of posterior sampling in the context of score based generative models. We have a trained score network for a prior $p(x)$, a measurement model $p(y|x)$, and are tasked with sampling from the posterior $p(x|y)$. Prior…

Machine Learning · Computer Science 2025-12-09 Advait Parulekar , Litu Rout , Karthikeyan Shanmugam , Sanjay Shakkottai

Stochastic-gradient sampling methods are often used to perform Bayesian inference on neural networks. It has been observed that the methods in which notions of differential geometry are included tend to have better performances, with the…

Machine Learning · Computer Science 2024-04-02 Hanlin Yu , Marcelo Hartmann , Bernardo Williams , Arto Klami

Data dispersed across multiple files are commonly integrated through probabilistic linkage methods, where even minimal error rates in record matching can significantly contaminate subsequent statistical analyses. In regression problems, we…

Statistics Theory · Mathematics 2024-09-18 Abhisek Chakraborty , Saptati Datta

The use of L1 regularisation for sparse learning has generated immense research interest, with successful application in such diverse areas as signal acquisition, image coding, genomics and collaborative filtering. While existing work…

Machine Learning · Computer Science 2012-08-20 Shakir Mohamed , Katherine Heller , Zoubin Ghahramani

Structured additive regression provides a general framework for complex Gaussian and non-Gaussian regression models, with predictors comprising arbitrary combinations of nonlinear functions and surfaces, spatial effects, varying…

Methodology · Statistics 2015-03-19 Fabian Scheipl , Ludwig Fahrmeir , Thomas Kneib

The first Bayesian results for the sparse normal means problem were proven for spike-and-slab priors. However, these priors are less convenient from a computational point of view. In the meanwhile, a large number of continuous shrinkage…

Statistics Theory · Mathematics 2016-08-16 Stéphanie van der Pas , Jean-Bernard Salomond , Johannes Schmidt-Hieber

Sparsity has become a key concept for solving of high-dimensional inverse problems using variational regularization techniques. Recently, using similar sparsity-constraints in the Bayesian framework for inverse problems by encoding them in…

Numerical Analysis · Mathematics 2014-11-18 Felix Lucka

We study Bayesian inference in the spiked covariance model, where a small number of spiked eigenvalues dominate the spectrum. Our goal is to infer the spiked eigenvalues, their corresponding eigenvectors, and the number of spikes, providing…

Statistics Theory · Mathematics 2025-08-20 Kwangmin Lee , Sewon Park , Seongmin Kim , Jaeyong Lee

In this paper we study grouped variable selection problems by proposing a specified prior, called the nested spike and slab prior, to model collective behavior of regression coefficients. At the group level, the nested spike and slab prior…

Methodology · Statistics 2011-06-30 Tso-Jung Yen , Yu-Min Yen

Probabilistic clustering models (or equivalently, mixture models) are basic building blocks in countless statistical models and involve latent random variables over discrete spaces. For these models, posterior inference methods can be…

Machine Learning · Statistics 2020-06-24 Ari Pakman , Yueqi Wang , Catalin Mitelut , JinHyung Lee , Liam Paninski

Gaussian graphical models have been used to study intrinsic dependence among several variables, but the Gaussianity assumption may be restrictive in many applications. A nonparanormal graphical model is a semiparametric generalization for…

Methodology · Statistics 2020-05-20 Jami J. Mulgrave , Subhashis Ghosal

In all areas of human knowledge, datasets are increasing in both size and complexity, creating the need for richer statistical models. This trend is also true for economic data, where high-dimensional and nonlinear/nonparametric inference…

Econometrics · Economics 2021-12-23 Dimitris Korobilis , Kenichi Shimizu

We consider Bayesian inference of sparse covariance matrices and propose a post-processed posterior. This method consists of two steps. In the first step, posterior samples are obtained from the conjugate inverse-Wishart posterior without…

Statistics Theory · Mathematics 2021-08-24 Kwangmin Lee , Jaeyong Lee

In the popular approach of "Bayesian variable selection" (BVS), one uses prior and posterior distributions to select a subset of candidate variables to enter the model. A completely new direction will be considered here to study BVS with a…

Methodology · Statistics 2008-11-03 Wenxin Jiang , Martin A. Tanner

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi