English
Related papers

Related papers: Minimax rank estimation for subspace tracking

200 papers

The label ranking problem is a supervised learning scenario in which the learner predicts a total order of the class labels for a given input instance. Recently, research has increasingly focused on the partial label ranking problem, a…

Machine Learning · Computer Science 2025-10-24 Jiayi Wang , Juan C. Alfaro , Viktor Bengs

This paper studies the problem of recovering a low-rank matrix from several noisy random linear measurements. We consider the setting where the rank of the ground-truth matrix is unknown a priori and use an objective function built from a…

Optimization and Control · Mathematics 2025-07-29 Lijun Ding , Zhen Qin , Liwei Jiang , Jinxin Zhou , Zhihui Zhu

In this article, we develop methods for estimating a low rank tensor from noisy observations on a subset of its entries to achieve both statistical and computational efficiencies. There have been a lot of recent interests in this problem of…

Machine Learning · Statistics 2018-03-21 Dong Xia , Ming Yuan , Cun-Hui Zhang

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi

We consider the problem of noisy matrix completion, in which the goal is to reconstruct a structured matrix whose entries are partially observed in noise. Standard approaches to this underdetermined inverse problem are based on assuming…

Machine Learning · Statistics 2017-09-04 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

Estimating the rank of a corrupted data matrix is an important task in data analysis, most notably for choosing the number of components in PCA. Significant progress on this task was achieved using random matrix theory by characterizing the…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Thomas T. C. K. Zhang , Yuval Kluger

This paper considers the problem of matrix-variate logistic regression. It derives the fundamental error threshold on estimating low-rank coefficient matrices in the logistic regression problem by obtaining a lower bound on the minimax…

Machine Learning · Computer Science 2022-05-10 Batoul Taki , Mohsen Ghassemi , Anand D. Sarwate , Waheed U. Bajwa

Spectral methods are widely used to estimate eigenvectors of a low-rank signal matrix subject to noise. These methods use the leading eigenspace of an observed matrix to estimate this low-rank signal. Typically, the entrywise estimation…

Statistics Theory · Mathematics 2024-11-01 Hao Yan , Keith Levin

A key issue in statistics and machine learning is to automatically select the "right" model complexity, e.g., the number of neighbors to be averaged over in k nearest neighbor (kNN) regression or the polynomial degree in regression with…

Machine Learning · Computer Science 2010-10-04 Marcus Hutter , Minh-Ngoc Tran

In this paper, we address the problem of estimating transport surplus (a.k.a. matching affinity) in high dimensional optimal transport problems. Classical optimal transport theory specifies the matching affinity and determines the optimal…

Methodology · Statistics 2017-01-02 Arnaud Dupuy , Alfred Galichon , Yifei Sun

The two-sample problem, which consists in testing whether independent samples on $\mathbb{R}^d$ are drawn from the same (unknown) distribution, finds applications in many areas. Its study in high-dimension is the subject of much attention,…

Statistics Theory · Mathematics 2023-02-09 Stephan Clémençon , Myrto Limnios , Nicolas Vayatis

We consider the classic problem of establishing a statistical ranking of a set of n items given a set of inconsistent and incomplete pairwise comparisons between such items. Instantiations of this problem occur in numerous applications in…

Machine Learning · Computer Science 2015-04-07 Mihai Cucuringu

This paper studies the inference about linear functionals of high-dimensional low-rank matrices. While most existing inference methods would require consistent estimation of the true rank, our procedure is robust to rank misspecification,…

Econometrics · Economics 2024-10-21 Jungjun Choi , Hyukjun Kwon , Yuan Liao

In classical statistics, a well known paradigm consists in establishing asymptotic equivalence between an experiment of i.i.d. observations and a Gaussian shift experiment, with the aim of obtaining optimal estimators in the former…

Statistics Theory · Mathematics 2023-08-31 Samriddha Lahiry , Michael Nussbaum

Ranking objects is a simple and natural procedure for organizing data. It is often performed by assigning a quality score to each object according to its relevance to the problem at hand. Ranking is widely used for object selection, when…

Artificial Intelligence · Computer Science 2012-06-26 Or Zuk , Liat Ein-Dor , Eytan Domany

We introduce a new criterion, the Rank Selection Criterion (RSC), for selecting the optimal reduced rank estimator of the coefficient matrix in multivariate response regression models. The corresponding RSC estimator minimizes the Frobenius…

Statistics Theory · Mathematics 2011-10-18 Florentina Bunea , Yiyuan She , Marten H. Wegkamp

Substantial progress has been made recently on developing provably accurate and efficient algorithms for low-rank matrix factorization via nonconvex optimization. While conventional wisdom often takes a dim view of nonconvex optimization…

Machine Learning · Computer Science 2019-10-23 Yuejie Chi , Yue M. Lu , Yuxin Chen

We consider a $d$-dimensional continuous martingale $X(t)$ with quadratic variation matrix $\langle X\rangle_t=\int_0^t \Sigma(s)\,ds$ and develop tests for the rank of its spot covariance matrix $\Sigma(t)$, $t\in[0,1]$. The process $X$ is…

Statistics Theory · Mathematics 2026-01-14 Markus Reiß , Lars Winkelmann

The estimation of high dimensional quantum states is an important statistical problem arising in current quantum technology applications. A key example is the tomography of multiple ions states, employed in the validation of state…

Quantum Physics · Physics 2015-12-09 Cristina Butucea , Madalin Guta , Theodore Kypraios

This study explores using embedding rank as an unsupervised evaluation metric for general-purpose speech encoders trained via self-supervised learning (SSL). Traditionally, assessing the performance of these encoders is resource-intensive…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Zakaria Aldeneh , Vimal Thilak , Takuya Higuchi , Barry-John Theobald , Tatiana Likhomanenko
‹ Prev 1 3 4 5 6 7 10 Next ›