English
Related papers

Related papers: Inference for Low-rank Models without Estimating t…

200 papers

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde

For some variants of regression models, including partial, measurement error or error-in-variables, latent effects, semi-parametric and otherwise corrupted linear models, the classical parametric tests generally do not perform well. Various…

Statistics Theory · Mathematics 2015-03-25 Pranab K. Sen , Jana Jureckova , Jan Picek

Recently, fundamental conditions on the sampling patterns have been obtained for finite completability of low-rank matrices or tensors given the corresponding ranks. In this paper, we consider the scenario where the rank is not given and we…

Machine Learning · Computer Science 2017-11-03 Morteza Ashraphijuo , Xiaodong Wang , Vaneet Aggarwal

The problem of low-rank matrix estimation recently received a lot of attention due to challenging applications. A lot of work has been done on rank-penalized methods and convex relaxation, both on the theoretical and applied sides. However,…

Machine Learning · Statistics 2018-06-27 Pierre Alquier

This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition…

Numerical Analysis · Mathematics 2020-08-12 Rishi Advani , Madison Crim , Sean O'Hagan

Ranking populations such as institutions based on certain characteristics is often of interest, and these ranks are typically estimated using samples drawn from the populations. Due to sample randomness, it is important to quantify the…

Methodology · Statistics 2025-12-08 Onrina Chandra , Min-ge Xie

In this paper, we consider the statistical inference for several low-rank tensor models. Specifically, in the Tucker low-rank tensor PCA or regression model, provided with any estimates achieving some attainable error rate, we develop the…

Statistics Theory · Mathematics 2021-11-01 Dong Xia , Anru R. Zhang , Yuchen Zhou

Low-rank structure is a common implicit assumption in many modern reinforcement learning (RL) algorithms. For instance, reward-free and goal-conditioned RL methods often presume that the successor measure admits a low-rank representation.…

Machine Learning · Computer Science 2025-11-06 Bastien Dubail , Stefan Stojanovic , Alexandre Proutière

We consider in this paper the multivariate regression problem, when the target regression matrix $A$ is close to a low rank matrix. Our primary interest in on the practical case where the variance of the noise is unknown. Our main…

Statistics Theory · Mathematics 2011-06-24 Christophe Giraud

This paper considers the problem of inference after ranking. In our setting, we are interested in any population whose rank according to some random quantity, such as an estimated treatment effect, a measure of value-added, or benefit (net…

Econometrics · Economics 2026-01-06 Andreas Petrou-Zeniou , Azeem M. Shaikh

Due to its strong interpretability, linear regression is widely used in social science, from which significance test provides the significance level of models or coefficients in the traditional statistical inference. However, linear…

Machine Learning · Computer Science 2020-06-08 Jiaye Teng , Yang Yuan

Low rank inference on matrices is widely conducted by optimizing a cost function augmented with a penalty proportional to the nuclear norm $\Vert \cdot \Vert_*$. However, despite the assortment of computational methods for such problems,…

Machine Learning · Statistics 2025-10-08 Simon Segert , Nathan Wycoff

We study a panel data model with general heterogeneous effects where slopes are allowed to vary across both individuals and over time. The key dimension reduction assumption we employ is that the heterogeneous slopes can be expressed as…

Statistics Theory · Mathematics 2019-09-05 Victor Chernozhukov , Christian Hansen , Yuan Liao , Yinchu Zhu

This article is an extended version of previous work of the authors [40, 41] on low-rank matrix estimation in the presence of constraints on the factors into which the matrix is factorized. Low-rank matrix factorization is one of the basic…

Statistics Theory · Mathematics 2017-08-28 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

The article concerns low-rank approximation of matrices generated by sampling a smooth function of two $m$-dimensional variables. We identify several misconceptions surrounding a claim that, for a specific class of analytic functions, such…

Numerical Analysis · Mathematics 2025-09-09 Stanislav Budzinskiy

Matrices of (approximate) low rank are pervasive in data science, appearing in recommender systems, movie preferences, topic models, medical records, and genomics. While there is a vast literature on how to exploit low rank structure in…

Machine Learning · Computer Science 2018-05-31 Madeleine Udell , Alex Townsend

The paper addresses the problem of low-rank trace norm minimization. We propose an algorithm that alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is characterized by an efficient factorization…

Optimization and Control · Mathematics 2013-06-04 B. Mishra , G. Meyer , F. Bach , R. Sepulchre

Low Rank Approximation is among most fundamental subjects of numerical linear algebra having important applications to various areas of modern computing and %they range from machine learning theory and %neural networks to data mining and…

Numerical Analysis · Mathematics 2018-09-25 Victor Y. Pan , Qi Luan , John Svadlenka , Liang Zhao

In order to test if an unknown matrix has a given rank (null hypothesis), we consider the family of statistics that are minimum squared distances between an estimator and the manifold of fixed-rank matrix. Under the null hypothesis, every…

Statistics Theory · Mathematics 2013-01-09 François Portier , Bernard Delyon

The problem of approximating a matrix by a low-rank one has been extensively studied. This problem assumes, however, that the whole matrix has a low-rank structure. This assumption is often false for real-world matrices. We consider the…

Data Structures and Algorithms · Computer Science 2025-11-05 Martino Ciaperoni , Aristides Gionis , Heikki Mannila