中文
相关论文

相关论文: Consistent Bayesian Sparsity Selection for High-di…

200 篇论文

In this paper we consider the task of estimating the non-zero pattern of the sparse inverse covariance matrix of a zero-mean Gaussian random vector from a set of iid samples. Note that this is also equivalent to recovering the underlying…

机器学习 · 计算机科学 2012-02-28 Christopher C. Johnson , Ali Jalali , Pradeep Ravikumar

Two key challenges in modern statistical applications are the large amount of information recorded per individual, and that such data are often not collected all at once but in batches. These batch effects can be complex, causing…

应用统计 · 统计学 2019-05-21 Alejandra Avalos-Pacheco , David Rossell , Richard S. Savage

We propose to compute a sparse approximate inverse Cholesky factor $L$ of a dense covariance matrix $\Theta$ by minimizing the Kullback-Leibler divergence between the Gaussian distributions $\mathcal{N}(0, \Theta)$ and $\mathcal{N}(0,…

数值分析 · 数学 2021-10-26 Florian Schäfer , Matthias Katzfuss , Houman Owhadi

We propose a generative model for robust tensor factorization in the presence of both missing data and outliers. The objective is to explicitly infer the underlying low-CP-rank tensor capturing the global information and a sparse tensor…

计算机视觉与模式识别 · 计算机科学 2016-06-21 Qibin Zhao , Guoxu Zhou , Liqing Zhang , Andrzej Cichocki , Shun-ichi Amari

The sparse structure of the solution for an inverse problem can be modelled using different sparsity enforcing priors when the Bayesian approach is considered. Analytical expression for the unknowns of the model can be obtained by building…

应用统计 · 统计学 2017-05-31 Mircea Dumitru

Dense kernel matrices resulting from pairwise evaluations of a kernel function arise naturally in machine learning and statistics. Previous work in constructing sparse approximate inverse Cholesky factors of such matrices by minimizing…

统计计算 · 统计学 2025-05-12 Stephen Huan , Joseph Guinness , Matthias Katzfuss , Houman Owhadi , Florian Schäfer

The choice of tuning parameters in Bayesian variable selection is a critical problem in modern statistics. In particular, for Bayesian linear regression with non-local priors, the scale parameter in the non-local prior density is an…

统计理论 · 数学 2019-02-25 Xuan Cao , Kshitij Khare , Malay Ghosh

In high-dimensions, many variable selection methods, such as the lasso, are often limited by excessive variability and rank deficiency of the sample covariance matrix. Covariance sparsity is a natural phenomenon in high-dimensional…

统计方法学 · 统计学 2010-06-08 X. Jessie Jeng And Z. John Daye

In this paper we develop a novel approach for estimating large and sparse dynamic factor models using variational inference, also allowing for missing data. Inspired by Bayesian variable selection, we apply slab-and-spike priors onto the…

统计方法学 · 统计学 2022-10-14 Erik Spånberg

Gaussian graphical models are a popular tool to learn the dependence structure in the form of a graph among variables of interest. Bayesian methods have gained in popularity in the last two decades due to their ability to simultaneously…

统计理论 · 数学 2019-04-02 Yabo Niu , Debdeep Pati , Bani Mallick

We reconsider a nonparametric density model based on Gaussian processes. By augmenting the model with latent P\'olya--Gamma random variables and a latent marked Poisson process we obtain a new likelihood which is conjugate to the model's…

机器学习 · 统计学 2018-05-30 Christian Donner , Manfred Opper

We study the rate of Bayesian consistency for hierarchical priors consisting of prior weights on a model index set and a prior on a density model for each choice of model index. Ghosal, Lember and Van der Vaart [2] have obtained general…

统计理论 · 数学 2008-09-23 Yang Xing

Multivariate categorical data occur in many applications of machine learning. One of the main difficulties with these vectors of categorical variables is sparsity. The number of possible observations grows exponentially with vector length,…

机器学习 · 统计学 2015-03-10 Yarin Gal , Yutian Chen , Zoubin Ghahramani

We address the curse of dimensionality in dynamic covariance estimation by modeling the underlying co-volatility dynamics of a time series vector through latent time-varying stochastic factors. The use of a global-local shrinkage prior for…

统计方法学 · 统计学 2019-08-07 Gregor Kastner

We consider jointly estimating the coefficient matrix and the error precision matrix in high-dimensional multivariate linear regression models. Bayesian methods in this context often face computational challenges, leading to previous…

统计方法学 · 统计学 2025-08-25 Xuan Cao , Kyoungjae Lee

We consider sparse Bayesian estimation in the classical multivariate linear regression model with $p$ regressors and $q$ response variables. In univariate Bayesian linear regression with a single response $y$, shrinkage priors which can be…

统计方法学 · 统计学 2018-05-21 Ray Bai , Malay Ghosh

In the present work, we consider variable selection and shrinkage for the Gaussian dynamic linear regression within a Bayesian framework. In particular, we propose a novel method that allows for time-varying sparsity, based on an extension…

统计方法学 · 统计学 2020-09-30 Paloma W. Uribe , Hedibert F. Lopes

We present a novel Bayesian approach for high-dimensional grouped regression under sparsity. We leverage a sparse projection method that uses a sparsity-inducing map to derive an induced posterior on a lower-dimensional parameter space. Our…

统计方法学 · 统计学 2026-05-25 Samhita Pal , Subhashis Ghosal

As evidenced by various recent and significant papers within the frequentist literature, along with numerous applications in macroeconomics, genomics, and neuroscience, there continues to be substantial interest to understand the…

统计方法学 · 统计学 2019-06-13 Jonathan P Williams , Yuying Xie , Jan Hannig

We study high-dimensional Bayesian linear regression with product priors. Using the nascent theory of non-linear large deviations (Chatterjee and Dembo,2016), we derive sufficient conditions for the leading-order correctness of the naive…

统计理论 · 数学 2021-04-27 Sumit Mukherjee , Subhabrata Sen