English
Related papers

Related papers: Tackling small eigen-gaps: Fine-grained eigenvecto…

200 papers

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

Functional data analysis is an important research field in statistics which treats data as random functions drawn from some infinite-dimensional functional space, and functional principal component analysis (FPCA) based on…

Statistics Theory · Mathematics 2024-04-03 Hang Zhou , Dongyi Wei , Fang Yao

Evaluation of the eigenvectors of symmetric tridiagonal matrices is one of the most basic tasks in numerical linear algebra. It is a widely known fact that, in the case of well separated eigenvalues, the eigenvectors can be evaluated with…

Numerical Analysis · Mathematics 2014-08-27 Andrei Osipov

Low-rank matrix completion concerns the problem of estimating unobserved entries in a matrix using a sparse set of observed entries. We consider the non-uniform setting where the observed entries are sampled with highly varying…

Machine Learning · Statistics 2024-03-04 Xumei Xi , Christina Lee Yu , Yudong Chen

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

Machine Learning · Statistics 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

A common challenge faced in quantum physics is finding the extremal eigenvalues and eigenvectors of a Hamiltonian matrix in a vector space so large that linear algebra operations on general vectors are not possible. There are numerous…

Nuclear Theory · Physics 2018-07-18 Dillon Frame , Rongzheng He , Ilse Ipsen , Daniel Lee , Dean Lee , Ermal Rrapaj

Linear regression without correspondences is the problem of performing a linear regression fit to a dataset for which the correspondences between the independent samples and the observations are unknown. Such a problem naturally arises in…

Machine Learning · Computer Science 2019-10-07 Manolis C. Tsakiris , Liangzu Peng , Aldo Conca , Laurent Kneip , Yuanming Shi , Hayoung Choi

This paper studies noisy low-rank matrix completion: given partial and noisy entries of a large low-rank matrix, the goal is to estimate the underlying matrix faithfully and efficiently. Arguably one of the most popular paradigms to tackle…

Machine Learning · Statistics 2019-10-08 Yuxin Chen , Yuejie Chi , Jianqing Fan , Cong Ma , Yuling Yan

Several key questions remain unanswered regarding overparameterized learning models. It is unclear how (stochastic) gradient descent finds solutions that generalize well, and in particular the role of small random initializations. Matrix…

Machine Learning · Computer Science 2025-08-25 Johan S. Wind

In safety-critical applications like medical diagnosis, certainty associated with a model's prediction is just as important as its accuracy. Consequently, uncertainty estimation and reduction play a crucial role. Uncertainty in predictions…

Image and Video Processing · Electrical Eng. & Systems 2023-09-12 Abhishek Singh Sambyal , Narayanan C. Krishnan , Deepti R. Bathula

This paper investigates the signal detection problem in colored Gaussian noise with an unknown covariance matrix. To be specific, we consider a sample deficient scenario in which the number of signal bearing samples ($n$) is strictly…

Signal Processing · Electrical Eng. & Systems 2024-04-26 Prathapasinghe Dharmawansa , Saman Atapattu , Jamie Evans , Kandeepan Sithamparanathan

We propose a method for estimating the entries of a large noisy matrix when the variance of the noise, $\sigma^2$, is unknown without putting any assumption on the rank of the matrix. We consider the estimator for $\sigma$ introduced by…

Statistics Theory · Mathematics 2019-10-30 Mona Azadkia

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

This paper presents a method for computing eigenvalues and eigenvectors for some types of nonlinear eigenvalue problems. The main idea is to approximate the functions involved in the eigenvalue problem by rational functions and then apply a…

Numerical Analysis · Mathematics 2020-06-11 Yousef Saad , Mohamed El-Guide , Agnieszka Międlar

A problem of online estimation of unknown parameters is considered for a linear regression equation, which is affected by an additive perturbation that can be caused by measurement noise (that corrupts regressor and regressand), as well as…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Anton Glushchenko , Konstantin Lastochkin

The eigenvalue problem plays a central role in linear algebra and its applications in control and optimization methods. In particular, many matrix decompositions rely upon computation of eigenvalue-eigenvector pairs, such as diagonal or…

Optimization and Control · Mathematics 2016-07-15 Pavel Osinenko , Grigory Devadze , Stefan Streif

This paper is devoted to a novel quantitative imaging scheme of identifying impenetrable obstacles in time-harmonic acoustic scattering from the associated far-field data. The proposed method consists of two phases. In the first phase, we…

Numerical Analysis · Mathematics 2023-07-05 Youzi He , Hongyu Liu , Xianchao Wang

Inspired by the key principle behind the EM algorithm, we propose a general methodology for conducting wavelet estimation with irregularly-spaced data by viewing the data as the observed portion of an augmented regularly-spaced data set. We…

Statistics Theory · Mathematics 2007-06-13 Thomas C. M. Lee , Xiao-Li Meng

This paper concerns the estimation of the regression function at a given point in nonparametric heteroscedastic models with Gaussian noise or with noise having unknown distribution. In the two cases an asymptotically efficient kernel…

Statistics Theory · Mathematics 2007-11-30 Jean-Yves Brua

We propose two different strategies to find eigenvalues and eigenvectors of a given, not necessarily Hermitian, matrix $A$. Our methods apply also to the case of complex eigenvalues, making the strategies interesting for applications to…

Mathematical Physics · Physics 2020-06-24 Fabio Bagarello , Francesco Gargano