English
Related papers

Related papers: Uncertainty Quantification in Bayesian Reduced-Ran…

200 papers

We consider the problem of uncertainty quantification for an unknown low-rank matrix $\mathbf{X}$, given a partial and noisy observation of its entries. This quantification of uncertainty is essential for many real-world problems, including…

Methodology · Statistics 2022-03-28 Henry Shaowu Yuchi , Simon Mak , Yao Xie

We develop a Bayesian methodology aimed at simultaneously estimating low-rank and row-sparse matrices in a high-dimensional multiple-response linear regression model. We consider a carefully devised shrinkage prior on the matrix of…

Methodology · Statistics 2019-04-10 Antik Chakraborty , Anirban Bhattacharya , Bani K. Mallick

We consider the problem of estimating high-dimensional covariance matrices of a particular structure, which is a summation of low rank and sparse matrices. This covariance structure has a wide range of applications including factor analysis…

Methodology · Statistics 2013-10-17 Lin Zhang , Abhra Sarkar , Bani K. Mallick

We propose a novel framework for joint magnetic resonance image reconstruction and uncertainty quantification using under-sampled k-space measurements. The problem is formulated as a Bayesian linear inverse problem, where prior…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Ahmed Karam Eldaly , Matteo Figini , Daniel C. Alexander

Parameter estimation and inference from complex survey samples typically focuses on global model parameters whose estimators have asymptotic properties, such as from fixed effects regression models. The central challenge is to both mitigate…

Methodology · Statistics 2026-05-13 Matthew R. Williams , F. Hunter McGuire , Terrance D. Savitsky

The aim of reduced rank regression is to connect multiple response variables to multiple predictors. This model is very popular, especially in biostatistics where multiple measurements on individuals can be re-used to predict multiple…

Methodology · Statistics 2022-06-20 The Tien Mai , Pierre Alquier

Bayesian neural networks and deep ensembles represent two modern paradigms of uncertainty quantification in deep learning. Yet these approaches struggle to scale mainly due to memory inefficiency issues, since they require parameter storage…

Machine Learning · Statistics 2021-11-24 Hippolyt Ritter , Martin Kukla , Cheng Zhang , Yingzhen Li

We present a novel Bayesian nonparametric regression model for covariates X and continuous, real response variable Y. The model is parametrized in terms of marginal distributions for Y and X and a regression function which tunes the…

Methodology · Statistics 2015-06-25 Tristan Gray-Davies , Chris Holmes , Francois Caron

We consider the problem of constructing a reduced-rank regression model whose coefficient parameter is represented as a singular value decomposition with sparse singular vectors. The traditional estimation procedure for the coefficient…

Machine Learning · Statistics 2019-11-04 Kohei Yoshikawa , Shuichi Kawano

We consider the problem of Bayesian regression with trustworthy uncertainty quantification. We define that the uncertainty quantification is trustworthy if the ground truth can be captured by intervals dependent on the predictive…

Machine Learning · Statistics 2024-07-30 Zhenyuan Yuan , Thinh T. Doan

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

Methodology · Statistics 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

Recovery of low-rank matrices has recently seen significant activity in many areas of science and engineering, motivated by recent theoretical results for exact reconstruction guarantees and interesting practical applications. A number of…

Machine Learning · Statistics 2011-09-12 S. Derin Babacan , Martin Luessi , Rafael Molina , Aggelos K. Katsaggelos

The Bayesian Conjugate Gradient method (BayesCG) is a probabilistic generalization of the Conjugate Gradient method (CG) for solving linear systems with real symmetric positive definite coefficient matrices. Our CG-based implementation of…

Numerical Analysis · Mathematics 2022-10-04 Tim W. Reid , Ilse C. F. Ipsen , Jon Cockayne , Chris J. Oates

Uncertainty quantification for deep learning is a challenging open problem. Bayesian statistics offer a mathematically grounded framework to reason about uncertainties; however, approximate posteriors for modern neural networks still…

Machine Learning · Statistics 2020-01-23 Nicolas Brosse , Carlos Riquelme , Alice Martin , Sylvain Gelly , Éric Moulines

We present a novel approach for constrained Bayesian inference. Unlike current methods, our approach does not require convexity of the constraint set. We reduce the constrained variational inference to a parametric optimization over the…

Machine Learning · Computer Science 2013-09-27 Oluwasanmi Koyejo , Joydeep Ghosh

Reduced-rank (RR) regression may be interpreted as a dimensionality reduction technique able to reveal complex relationships among the data parsimoniously. However, RR regression models typically overlook any potential group structure among…

Methodology · Statistics 2024-06-26 Maria F. Pintado , Matteo Iacopini , Luca Rossini , Alexander Y. Shestopaloff

This paper revisits the problem of decomposing a positive semidefinite matrix as a sum of a matrix with a given rank plus a sparse matrix. An immediate application can be found in portfolio optimization, when the matrix to be decomposed is…

Optimization and Control · Mathematics 2021-06-16 Michel Baes , Calypso Herrera , Ariel Neufeld , Pierre Ruyssen

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

The problem of low-rank matrix completion with heterogeneous and sub-exponential (as opposed to homogeneous and Gaussian) noise is particularly relevant to a number of applications in modern commerce. Examples include panel sales data and…

Machine Learning · Statistics 2021-10-26 Vivek F. Farias , Andrew A. Li , Tianyi Peng

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei
‹ Prev 1 2 3 10 Next ›