English
Related papers

Related papers: Covariance estimation under one-bit quantization

200 papers

In many practical situations we would like to estimate the covariance matrix of a set of variables from an insufficient amount of data. More specifically, if we have a set of $N$ independent, identically distributed measurements of an $M$…

Probability · Mathematics 2010-10-05 Thomas L. Marzetta , Gabriel H. Tucci , Steven H. Simon

This paper deals with the problem of estimating the covariance matrix of a series of independent multivariate observations, in the case where the dimension of each observation is of the same order as the number of observations. Although…

Information Theory · Computer Science 2015-06-03 Jianfeng Yao , Abla Kammoun , Jamal Najim

This paper concerns the problem of 1-bit compressed sensing, where the goal is to estimate a sparse signal from a few of its binary measurements. We study a non-convex sparsity-constrained program and present a novel and concise analysis…

Machine Learning · Computer Science 2020-07-10 Jie Shen

A classical approach to accurately estimating the covariance matrix \Sigma of a p-variate normal distribution is to draw a sample of size n > p and form a sample covariance matrix. However, many modern applications operate with much smaller…

Statistics Theory · Mathematics 2014-03-05 Elizaveta Levina , Roman Vershynin

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

There is growing interest in improving our algorithmic understanding of fundamental statistical problems such as mean estimation, driven by the goal of understanding the limits of what we can extract from valuable data. The state of the art…

Statistics Theory · Mathematics 2023-11-22 Trung Dang , Jasper C. H. Lee , Maoyuan Song , Paul Valiant

We consider the problem of determining the weights of a quantum ensemble. That is to say, given a quantum system that is in a set of possible known states according to an unknown probability law, we give strategies to estimate the…

Quantum Physics · Physics 2010-02-01 J. I. de Vicente , J. Calsamiglia , R. Munoz-Tapia , E. Bagan

The problem of estimating a normal covariance matrix is considered from a decision-theoretic point of view, where the dimension of the covariance matrix is larger than the sample size. This paper addresses not only the nonsingular case but…

Statistics Theory · Mathematics 2015-06-03 Hisayuki Tsukuma

In practice, observations are often contaminated by noise, making the resulting sample covariance matrix to be an information-plus-noise-type covariance matrix. Aiming to make inferences about the spectra of the underlying true covariance…

Statistics Theory · Mathematics 2015-08-25 Ningning Xia , Xinghua Zheng

We consider the problem of estimating the mean of a normal distribution under the following constraint: the estimator can access only a single bit from each sample from this distribution. We study the squared error risk in this estimation…

Statistics Theory · Mathematics 2017-10-12 Alon Kipnis , John C. Duchi

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

In this article, we derive concentration inequalities for the spectral norm of two classical sample estimators of large dimensional Toeplitz covariance matrices, demonstrating in particular their asymptotic almost sure consistence. The…

Information Theory · Computer Science 2015-10-28 Julia Vinogradova , Romain Couillet , Walid Hachem

In this paper, we introduce a distributed algorithm that optimizes the Gaussian signal covariance matrices of multi-antenna users transmitting to a common multi-antenna receiver under imperfect and possibly delayed channel state…

Information Theory · Computer Science 2015-02-06 Panayotis Mertikopoulos , Aris L. Moustakas

Gaussian graphical models are used for determining conditional relationships between variables. This is accomplished by identifying off-diagonal elements in the inverse-covariance matrix that are non-zero. When the ratio of variables (p) to…

Applications · Statistics 2018-08-07 Donald R. Williams , Juho Piironen , Aki Vehtari , Philippe Rast

Gaussian processes are a natural way of defining prior distributions over functions of one or more input variables. In a simple nonparametric regression problem, where such a function gives the mean of a Gaussian distribution for an…

Data Analysis, Statistics and Probability · Physics 2008-02-03 Radford M. Neal

We study the approximation of expectations $\E(f(X))$ for Gaussian random elements $X$ with values in a separable Hilbert space $H$ and Lipschitz continuous functionals $f \colon H \to \R$. We consider restricted Monte Carlo algorithms,…

Numerical Analysis · Mathematics 2018-02-15 Michael B. Giles , Mario Hefter , Lukas Mayer , Klaus Ritter

Robustness to outliers is often a desirable property of statistical estimators. Indeed many well known estimators offer very good optimal performance in theory but are unusable in applied contexts because of their sensitivity to outliers.…

Statistics Theory · Mathematics 2016-12-01 Christophe Culan , Claude Adnet

Simulating sample correlation matrices is important in many areas of statistics. Approaches such as generating Gaussian data and finding their sample correlation matrix or generating random uniform $[-1,1]$ deviates as pairwise correlations…

Statistics Theory · Mathematics 2013-12-09 Johanna Hardin , Stephan Ramon Garcia , David Golan

Model uncertainty quantification is an essential component of effective data assimilation. Model errors associated with sub-grid scale processes are often represented through stochastic parameterizations of the unresolved process. Many…

Methodology · Statistics 2021-04-13 Sahani Pathiraja , Peter Jan van Leeuwen

Covariance matrix estimation is one of the most important problems in statistics. To accommodate the complexity of modern datasets, it is desired to have estimation procedures that not only can incorporate the structural assumptions of…

Statistics Theory · Mathematics 2017-06-13 Mengjie Chen , Chao Gao , Zhao Ren