English
Related papers

Related papers: Shrinkage priors on complex-valued circular-symmet…

200 papers

Many problems in machine learning can be formulated as optimizing a convex functional over a vector space of measures. This paper studies the convergence of the mirror descent algorithm in this infinite-dimensional setting. Defining Bregman…

Optimization and Control · Mathematics 2022-10-12 Pierre-Cyril Aubin-Frankowski , Anna Korba , Flavien Léger

Two-component mixture priors provide a traditional way to induce sparsity in high-dimensional Bayes models. However, several aspects of such a prior, including computational complexities in high-dimensions, interpretation of exact zeros and…

Statistics Theory · Mathematics 2016-05-19 Anirban Bhattacharya , David B. Dunson , Debdeep Pati , Natesh S. Pillai

The autoregressive moving average (ARMA) model is one of the most important models in time series analysis.We consider the Bayesian estimation of an unknown spectral density in the ARMA model.In the i.i.d. cases, Komaki showed that Bayesian…

Statistics Theory · Mathematics 2021-05-27 Fuyuhiko Tanaka , Fumiyasu Komaki

The preferred shape for the primordial spectrum of curvature perturbations is determined by performing a Bayesian model selection analysis of cosmological observations. We first reconstruct the spectrum modelled as piecewise linear in \log…

Cosmology and Nongalactic Astrophysics · Physics 2012-06-27 J. Alberto Vazquez , M. Bridges , M. P. Hobson , A. N. Lasenby

Suppose we have data generated according to a multivariate normal distribution with a fixed unknown mean vector that is sparse in the sense of being nearly black. Optimality of Bayes estimates and posterior concentration properties in terms…

Statistics Theory · Mathematics 2015-07-27 Prasenjit Ghosh , Arijit Chakrabarti

We develop a fully intrinsic Bayesian framework for nonparametric regression on the unit sphere based on isotropic Gaussian field priors and the harmonic structure induced by the Laplace-Beltrami operator. Under uniform random design, the…

Statistics Theory · Mathematics 2026-01-29 Claudio Durastanti

Autoregressive cokriging models have been widely used to emulate multiple computer models with different levels of fidelity. The dependence structures are modeled via Gaussian processes at each level of fidelity, where covariance structures…

Statistics Theory · Mathematics 2020-11-03 Pulong Ma

We propose a novel class of dynamic shrinkage processes for Bayesian time series and regression analysis. Building upon a global-local framework of prior construction, in which continuous scale mixtures of Gaussian distributions are…

Methodology · Statistics 2019-07-02 Daniel R. Kowal , David S. Matteson , David Ruppert

Bayesian methods are appealing in their flexibility in modeling complex data and ability in capturing uncertainty in parameters. However, when Bayes' rule does not result in tractable closed-form, most approximate inference algorithms lack…

Machine Learning · Computer Science 2016-05-09 Bo Dai , Niao He , Hanjun Dai , Le Song

We investigate the asymptotic behavior of posterior distributions of regression coefficients in high-dimensional linear models as the number of dimensions grows with the number of observations. We show that the posterior distribution…

Methodology · Statistics 2018-03-06 Artin Armagan , David B. Dunson , Jaeyong Lee , Waheed U. Bajwa , Nate Strawn

In bayesian wavelet shrinkage, the already proposed priors to wavelet coefficients are assumed to be symmetric around zero. Although this assumption is reasonable in many applications, it is not general. The present paper proposes the use…

Methodology · Statistics 2020-10-12 Alex Rodrigo dos Santos Sousa

Currently several Bayesian approaches are available to estimate large sparse precision matrices, including Bayesian graphical Lasso (Wang, 2012), Bayesian structure learning (Banerjee and Ghosal, 2015), and graphical horseshoe (Li et al.,…

Methodology · Statistics 2021-04-27 Ruoyang Zhang , Yisha Yao , Malay Ghosh

Many statistical problems include model parameters that are defined as the solutions to optimization sub-problems. These include classical approaches such as profile likelihood as well as modern applications involving flow networks or…

Methodology · Statistics 2025-03-17 Cheng Zeng , Yaozhi Yang , Jason Xu , Leo L Duan

Recent work has attempted to directly approximate the `function-space' or predictive posterior distribution of Bayesian models, without approximating the posterior distribution over the parameters. This is appealing in e.g. Bayesian neural…

Machine Learning · Statistics 2020-11-19 David R. Burt , Sebastian W. Ober , Adrià Garriga-Alonso , Mark van der Wilk

The power prior is a class of informative priors designed to incorporate historical data alongside current data in a Bayesian framework. It includes a power parameter that controls the influence of historical data, providing flexibility and…

Machine Learning · Statistics 2025-05-23 Masanari Kimura , Howard Bondell

Use of continuous shrinkage priors -- with a "spike" near zero and heavy-tails towards infinity -- is an increasingly popular approach to induce sparsity in parameter estimates. When the parameters are only weakly identified by the…

Methodology · Statistics 2021-09-17 Akihiko Nishimura , Marc A. Suchard

We introduce a new class of distributions named log-adjusted shrinkage priors for the analysis of sparse signals, which extends the three parameter beta priors by multiplying an additional log-term to their densities. The proposed prior has…

Methodology · Statistics 2020-01-28 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

We investigate the posterior rate of convergence for wavelet shrinkage using a Bayesian approach in general Besov spaces. Instead of studying the Bayesian estimator related to a particular loss function, we focus on the posterior…

Statistics Theory · Mathematics 2007-09-24 Heng Lian

We consider the asymptotic behavior of posterior distributions if the model is misspecified. Given a prior distribution and a random sample from a distribution $P_0$, which may not be in the support of the prior, we show that the posterior…

Statistics Theory · Mathematics 2007-06-13 B. J. K. Kleijn , A. W. van der Vaart

Shape restricted regressions, including isotonic regression and concave regression as special cases, are studied using priors on Bernstein polynomials and Markov chain Monte Carlo methods. These priors have large supports, select only…

Statistics Theory · Mathematics 2009-09-29 I-Shou Chang , Li-Chu Chien , Chao A. Hsiung , Chi-Chung Wen , Yuh-Jenn Wu