English
Related papers

Related papers: A note on the rank of a sparse random matrix

200 papers

The matrix completion problem aims to reconstruct a low-rank matrix based on a revealed set of possibly noisy entries. Prior works consider completing the entire matrix with generalization error guarantees. However, the completion accuracy…

Machine Learning · Computer Science 2023-12-19 Elad Hazan , Adam Tauman Kalai , Varun Kanade , Clara Mohri , Y. Jennifer Sun

We give the first input-sparsity time algorithms for the rank-$k$ low rank approximation problem in every Schatten norm. Specifically, for a given $n\times n$ matrix $A$, our algorithm computes $Y,Z\in \mathbb{R}^{n\times k}$, which, with…

Data Structures and Algorithms · Computer Science 2020-07-01 Yi Li , David Woodruff

A square matrix $M$ represents a graph $\Gamma$ if its nonzero off-diagonal entries encode the adjacencies of $\Gamma$, subject to a fixed ordering of the vertices. Over the field of two elements, we investigate the distribution of ranks in…

Combinatorics · Mathematics 2025-09-15 Badriah Safarji , Cian O'Brien , Rachel Quinlan

In this note, we investigate how well we can reconstruct the best rank-$r$ approximation of a large matrix from a small number of its entries. We show that even if a data matrix is of full rank and cannot be approximated well by a low-rank…

Methodology · Statistics 2021-11-12 Shun Xu , Ming Yuan

Proportionality is an attractive fairness concept that has been applied to a range of problems including the facility location problem, a classic problem in social choice. In our work, we propose a concept called Strong Proportionality,…

Computer Science and Game Theory · Computer Science 2022-06-15 Haris Aziz , Alexander Lam , Mashbat Suzuki , Toby Walsh

Motivated by the Koml\'os conjecture in combinatorial discrepancy, we study the discrepancy of random matrices with $m$ rows and $n$ independent columns drawn from a bounded lattice random variable. It is known that for $n$ tending to…

Combinatorics · Mathematics 2018-10-19 Cole Franks , Michael Saks

Rank regularized minimization problem is an ideal model for the low-rank matrix completion/recovery problem. The matrix factorization approach can transform the high-dimensional rank regularized problem to a low-dimensional factorized…

Optimization and Control · Mathematics 2024-05-21 Wenjing Li , Wei Bian , Kim-Chuan Toh

A symmetric positive semi-definite matrix A is called completely positive if there exists a matrix B with nonnegative entries such that A=BB^T. If B is such a matrix with a minimal number p of columns, then p is called the cp-rank of A. In…

Rings and Algebras · Mathematics 2016-04-22 Jan Brandts , Michal Krizek

Determining the precise rank is an important problem in many large-scale applications with matrix data exploiting low-rank plus noise models. In this paper, we suggest a universal approach to rank inference via residual subsampling (RIRS)…

Statistics Theory · Mathematics 2024-11-12 Xiao Han , Qing Yang , Yingying Fan

We study largest singular values of large random matrices, each with mean of a fixed rank $K$. Our main result is a limit theorem as the number of rows and columns approach infinity, while their ratio approaches a positive constant. It…

Probability · Mathematics 2021-03-02 Wlodek Bryc , Jack W. Silverstein

Square matrices appear in many machine learning problems and models. Optimization over a large square matrix is expensive in memory and in time. Therefore an economic approximation is needed. Conventional approximation approaches factorize…

Machine Learning · Computer Science 2021-09-20 Ruslan Khalitov , Tong Yu , Lei Cheng , Zhirong Yang

We introduce and study the problem of consistent low-rank approximation, in which rows of an input matrix $\mathbf{A}\in\mathbb{R}^{n\times d}$ arrive sequentially and the goal is to provide a sequence of subspaces that well-approximate the…

Data Structures and Algorithms · Computer Science 2026-03-03 David P. Woodruff , Samson Zhou

Given a fixed matrix, the problem of column subset selection requests a column submatrix that has favorable spectral properties. Most research from the algorithms and numerical linear algebra communities focuses on a variant called…

Numerical Analysis · Mathematics 2014-04-29 Joel A. Tropp

We design a new distribution over $\poly(r \eps^{-1}) \times n$ matrices $S$ so that for any fixed $n \times d$ matrix $A$ of rank $r$, with probability at least 9/10, $\norm{SAx}_2 = (1 \pm \eps)\norm{Ax}_2$ simultaneously for all $x \in…

Data Structures and Algorithms · Computer Science 2013-04-08 Kenneth L. Clarkson , David P. Woodruff

The aim of this note (as well as of the course itself) is to give a largely self-contained proof of two of the main results in the field of low-rank matrix recovery. This field aims for identification of low-rank matrices from only limited…

Functional Analysis · Mathematics 2016-09-27 Jan Vybiral

Let $M$ be a matroid on a finite ground set $E$, and suppose that the automorphism group of $M$ acts transitively on $E$. We show the following: if $X_1,\ldots,X_K$ are sampled independently from a distribution $p$ on $E$, then the…

Combinatorics · Mathematics 2026-05-25 Mladen Kovačević

We revisit the probabilistic construction of sparse random matrices where each column has a fixed number of nonzeros whose row indices are drawn uniformly at random with replacement. These matrices have a one-to-one correspondence with the…

Information Theory · Computer Science 2013-07-16 Bubacarr Bah , Jared Tanner

Low-rank matrix completion (LRMC) problems arise in a wide variety of applications. Previous theory mainly provides conditions for completion under missing-at-random samplings. This paper studies deterministic conditions for completion. An…

Machine Learning · Statistics 2016-10-12 Daniel L. Pimentel-Alarcón , Nigel Boston , Robert D. Nowak

This paper expands the analysis of randomized low-rank approximation beyond the Gaussian distribution to four classes of random matrices: (1) independent sub-Gaussian entries, (2) independent sub-Gaussian columns, (3) independent bounded…

Numerical Analysis · Mathematics 2023-08-14 Arvind K. Saibaba , Agnieszka Międlar

Consider a linear model $y = X \beta + z$, $z \sim N(0, \sigma^2 I_n)$. The Gram matrix $\Theta = \frac{1}{n} X'X$ is non-sparse, but it is approximately the sum of two components, a low-rank matrix and a sparse matrix, where neither…

Methodology · Statistics 2017-05-31 Zheng Tracy Ke , Fan Yang