English
Related papers

Related papers: Bayesian matrix completion: prior specification

200 papers

In this paper, we review the problem of matrix completion and expose its intimate relations with algebraic geometry, combinatorics and graph theory. We present the first necessary and sufficient combinatorial conditions for matrices of…

Machine Learning · Computer Science 2012-07-03 Franz Kiraly , Ryota Tomioka

The Dirichlet Process Mixture Model (DPMM) is a Bayesian non-parametric approach widely used for density estimation and clustering. In this manuscript, we study the choice of prior for the variance or precision matrix when Gaussian kernels…

Methodology · Statistics 2022-02-09 Wei Jing , Michail Papathomas , Silvia Liverani

Bayes nets are relatively recent innovations. As a result, most of their theoretical development has focused on the simplest class of single-author models. The introduction of more sophisticated multiple-author settings raises a variety of…

Artificial Intelligence · Computer Science 2013-03-25 Izhar Matzkevich , Bruce Abramson

We introduce non-stationary Mat\'ern field priors with stochastic partial differential equations, and construct correlation length-scaling with hyperpriors. We model both the hyperprior and the Mat\'ern prior as continuous-parameter random…

Statistics Theory · Mathematics 2016-12-12 Lassi Roininen , Mark Girolami , Sari Lasanen , Markku Markkanen

Generalized linear mixed models (GLMMs) are commonly used to analyze correlated discrete or continuous response data. In Bayesian GLMMs, the often-used improper priors may yield undesirable improper posterior distributions. Thus, verifying…

Methodology · Statistics 2025-01-17 Yalin Rao , Vivekananda Roy

The completion of a Euclidean distance matrix (EDM) from sparse and noisy observations is a fundamental challenge in signal processing, with applications in sensor network localization, acoustic room reconstruction, molecular conformation,…

Signal Processing · Electrical Eng. & Systems 2026-02-02 Rohit Varma Chiluvuri , Santosh Nannuru

In this paper, we present a unified analysis of matrix completion under general low-dimensional structural constraints induced by {\em any} norm regularization. We consider two estimators for the general problem of structured matrix…

Machine Learning · Statistics 2018-11-26 Suriya Gunasekar , Arindam Banerjee , Joydeep Ghosh

In Bayesian regression models with categorical predictors, constraints are needed to ensure identifiability when using all $K$ levels of a factor. The sum-to-zero constraint is particularly useful as it allows coefficients to represent…

Methodology · Statistics 2025-04-15 Zhi Ling , Shozen Dan

In a Bayesian context, prior specification for inference on monotone densities is conceptually straightforward, but proving posterior convergence theorems is complicated by the fact that desirable prior concentration properties often are…

Statistics Theory · Mathematics 2020-07-28 Ryan Martin

Bayesian hypothesis testing and minimax hypothesis testing represent extreme instances of detection in which the prior probabilities of the hypotheses are either completely and precisely known, or are completely unknown. Group minimax, also…

Information Theory · Computer Science 2013-07-25 Kush R. Varshney , Lav R. Varshney

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Ankit Parekh , Ivan W. Selesnick

This paper deals with Bayesian inference of a mixture of Gaussian distributions. A novel formulation of the mixture model is introduced, which includes the prior constraint that each Gaussian component is always assigned a minimal number of…

Methodology · Statistics 2014-05-21 Colin J. Stoneking

This paper provides the best bounds to date on the number of randomly sampled entries required to reconstruct an unknown low rank matrix. These results improve on prior work by Candes and Recht, Candes and Tao, and Keshavan, Montanari, and…

Information Theory · Computer Science 2009-10-21 Benjamin Recht

Low-rank matrix completion is an important problem with extensive real-world applications. When observations are uniformly sampled from the underlying matrix entries, existing methods all require the matrix to be incoherent. This paper…

Machine Learning · Computer Science 2015-02-11 Shusen Wang , Tong Zhang , Zhihua Zhang

We propose a set of convex low rank inducing norms for a coupled matrices and tensors (hereafter coupled tensors), which shares information between matrices and tensors through common modes. More specifically, we propose a mixture of the…

Machine Learning · Statistics 2018-06-15 Kishan Wimalawarne , Makoto Yamada , Hiroshi Mamitsuka

Bayesian model comparison requires the specification of a prior distribution on the parameter space of each candidate model. In this connection two concerns arise: on the one hand the elicitation task rapidly becomes prohibitive as the…

Methodology · Statistics 2011-02-16 Guido Consonni , Piero Veronese

We consider the problem of learning the structure of a high dimensional precision matrix under sparsity assumptions. We propose to use a shrinkage prior, called the DL-graphical prior based on the Dirichlet-Laplace prior used for the…

Statistics Theory · Mathematics 2019-08-08 Sayantan Banerjee

The Bayesian approach to inverse problems typically relies on posterior sampling approaches, such as Markov chain Monte Carlo, for which the generation of each sample requires one or more evaluations of the parameter-to-observable map or…

Computation · Statistics 2014-12-23 Jinglai Li , Youssef M. Marzouk

Bayesian analysis of data from the general linear mixed model is challenging because any nontrivial prior leads to an intractable posterior density. However, if a conditionally conjugate prior density is adopted, then there is a simple…

Statistics Theory · Mathematics 2013-02-19 Jorge Carlos Román , James P. Hobert

It is generally believed that ensemble approaches, which combine multiple algorithms or models, can outperform any single algorithm at machine learning tasks, such as prediction. In this paper, we propose Bayesian convex and linear…

Statistics Theory · Mathematics 2014-03-07 Yun Yang , David B. Dunson