English
Related papers

Related papers: Improved dependence on coherence in eigenvector an…

200 papers

We consider the problem of parameter estimation in a high-dimensional generalized linear model. Spectral methods obtained via the principal eigenvector of a suitable data-dependent matrix provide a simple yet surprisingly effective…

Statistics Theory · Mathematics 2025-07-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

In semivarying coefficient models for longitudinal/clustered data, usually of primary interest is usually the parametric component which involves unknown constant coefficients. First, we study semiparametric efficiency bound for estimation…

Methodology · Statistics 2015-09-15 Ming-Yen Cheng , Toshio Honda , Jialiang Li

Estimating a covariance matrix and its associated principal components is a fundamental problem in contemporary statistics. While optimal estimation procedures have been developed with well-understood properties, the increasing demand for…

Statistics Theory · Mathematics 2024-09-30 T. Tony Cai , Dong Xia , Mengyue Zha

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of…

Machine Learning · Statistics 2010-09-07 Mehryar Mohri , Ameet Talwalkar

Sparsity in the eigenvectors of signal covariance matrices is exploited in this paper for compression and denoising. Dimensionality reduction (DR) and quantization modules present in many practical compression schemes such as transform…

Applications · Statistics 2015-06-03 Ioannis D. Schizas , Georgios B. Giannakis

This paper studies two spectrum estimation methods for the case that the samples are obtained at a rate lower than the Nyquist rate. The first method is the correlogram method for undersampled data. The algorithm partitions the spectrum…

Statistics Theory · Mathematics 2013-11-25 Mahdi Shaghaghi , Sergiy A. Vorobyov

Blind methods often separate or identify signals or signal subspaces up to an unknown scaling factor. Sometimes it is necessary to cope with the scaling ambiguity, which can be done through reconstructing signals as they are received by…

Sound · Computer Science 2017-08-02 Zbyněk Koldovský , Francesco Nesta

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Terahertz Time Domain Spectroscopy (THz-TDS) systems have emerged as mature technologies with significant potential across various research fields and industries. However, the lack of standardized methods for signal and noise estimation and…

We consider the problem of approximating the set of eigenvalues of the covariance matrix of a multivariate distribution (equivalently, the problem of approximating the "population spectrum"), given access to samples drawn from the…

Machine Learning · Computer Science 2017-07-18 Weihao Kong , Gregory Valiant

In this paper, we consider the interference rejection combining (IRC) receiver, which improves the cell-edge user throughput via suppressing inter-cell interference and requires estimating the covariance matrix including the inter-cell…

Information Theory · Computer Science 2023-06-21 Jing Qian , Juening Jin , Hao Wang

We develop machinery to design efficiently computable and consistent estimators, achieving estimation error approaching zero as the number of observations grows, when facing an oblivious adversary that may corrupt responses in all but an…

Machine Learning · Computer Science 2021-11-05 Tommaso d'Orsi , Chih-Hung Liu , Rajai Nasser , Gleb Novikov , David Steurer , Stefan Tiegel

Many applications involve estimation of a signal matrix from a noisy data matrix. In such cases, it has been observed that estimators that shrink or truncate the singular values of the data matrix perform well when the signal matrix has…

Methodology · Statistics 2018-06-20 David Gerard , Peter Hoff

Partial coherence is an important quantity derived from spectral or precision matrices and is used in seismology, meteorology, oceanography, neuroscience and elsewhere. If the number of complex degrees of freedom only slightly exceeds the…

Statistics Theory · Mathematics 2016-11-03 D. Schneider-Luftman , A. T. Walden

A key quantity that occurs in the error analysis of several numerical methods for eigenvalue problems is the distance between the eigenvalue of interest and the next nearest eigenvalue. When we are interested in the smallest or fundamental…

Numerical Analysis · Mathematics 2024-12-20 Alexander D. Gilbert , Ivan G. Graham , Robert Scheichl , Ian H. Sloan

We consider the problem of recovering the unknown noise variance in the linear regression model. To estimate the nuisance (a vector of regression coefficients) we use a family of spectral regularisers of the maximum likelihood estimator.…

Statistics Theory · Mathematics 2017-11-28 Yuri Golubev , Ekaterina Krymova

This paper studies the related problems of prediction, covariance estimation, and principal component analysis for the spiked covariance model with heteroscedastic noise. We consider an estimator of the principal components based on…

Other Statistics · Statistics 2021-09-21 William Leeb , Elad Romanov

Low-rank matrix recovery problems involving high-dimensional and heterogeneous data appear in applications throughout statistics and machine learning. The contribution of this paper is to establish the fundamental limits of recovery for a…

Machine Learning · Statistics 2022-03-22 Joshua K. Behne , Galen Reeves

We present a mathematically justifiable, computationally simple, sample eigenvalue based procedure for estimating the number of high-dimensional signals in white noise using relatively few samples. The main motivation for considering a…

Statistics Theory · Mathematics 2007-05-23 N. Raj Rao , Alan Edelman

Spectral properties of random matrices play an important role in statistics, machine learning, communications, and many other areas. Engaging results regarding the convergence of the empirical spectral distribution (ESD) and the…

Statistics Theory · Mathematics 2025-07-08 Zeyan Zhuang , Xin Zhang , Dongfang Xu , Shenghui Song