English
Related papers

Related papers: Probabilistic Rank and Matrix Rigidity

200 papers

Matrices are exceptionally useful in various fields of study as they provide a convenient framework to organize and manipulate data in a structured manner. However, modern matrices can involve billions of elements, making their storage and…

Machine Learning · Computer Science 2023-10-18 Rajarshi Saha , Varun Srivastava , Mert Pilanci

This paper presents a deterministic, strongly polynomial time algorithm for computing the matrix rank for a class of symbolic matrices (whose entries are polynomials over a field). This class was introduced, in a different language, by…

Computational Complexity · Computer Science 2019-01-29 Orit E. Raz , Avi Wigderson

The log-rank conjecture is a longstanding open problem with multiple equivalent formulations in complexity theory and mathematics. In its linear-algebraic form, it asserts that the rank and partitioning number of a Boolean matrix are…

Computational Complexity · Computer Science 2026-03-02 Lianna Hambardzumyan , Shachar Lovett , Morgan Shirley

Given a real matrix A with n columns, the problem is to approximate the Gram product AA^T by c << n weighted outer products of columns of A. Necessary and sufficient conditions for the exact computation of AA^T (in exact arithmetic) from c…

Numerical Analysis · Mathematics 2014-05-16 John T. Holodnak , Ilse C. F. Ipsen

This work studies the maximum possible sign rank of $N \times N$ sign matrices with a given VC dimension $d$. For $d=1$, this maximum is {three}. For $d=2$, this maximum is $\tilde{\Theta}(N^{1/2})$. For $d >2$, similar but slightly less…

Combinatorics · Mathematics 2016-07-11 Noga Alon , Shay Moran , Amir Yehudayoff

Explainability models are now prevalent within machine learning to address the black-box nature of neural networks. The question now is which explainability model is most effective. Probabilistic Lipschitzness has demonstrated that the…

Machine Learning · Computer Science 2024-03-11 Lachlan Simpson , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

Suppose that we observe entries or, more generally, linear combinations of entries of an unknown $m\times T$-matrix $A$ corrupted by noise. We are particularly interested in the high-dimensional setting where the number $mT$ of unknown…

Statistics Theory · Mathematics 2011-05-16 Angelika Rohde , Alexandre B. Tsybakov

We develop a topological framework for proving lower bounds on sign-rank via $\mathbb{Z}_2$-equivariant topology, and use it to resolve the sign-rank of the Gap Hamming Distance problem up to lower-order terms. For every (partial) sign…

Combinatorics · Mathematics 2026-04-14 Florian Frick , Kaave Hosseini , Aliaksei Vasileuski

We design a new distribution over $\poly(r \eps^{-1}) \times n$ matrices $S$ so that for any fixed $n \times d$ matrix $A$ of rank $r$, with probability at least 9/10, $\norm{SAx}_2 = (1 \pm \eps)\norm{Ax}_2$ simultaneously for all $x \in…

Data Structures and Algorithms · Computer Science 2013-04-08 Kenneth L. Clarkson , David P. Woodruff

We determine the rank of a random matrix over an arbitrary field with prescribed numbers of non-zero entries in each row and column. As an application we obtain a formula for the rate of low-density parity check codes. This formula…

Combinatorics · Mathematics 2024-06-21 Amin Coja-Oghlan , Alperen A. Ergür , Pu Gao , Samuel Hetterich , Maurice Rolvien

Proving complexity lower bounds remains a challenging task: we only know how to prove conditional uniform lower bounds and nonuniform lower bounds in restricted circuit models. Williams (STOC 2010) showed how to derive nonuniform lower…

Computational Complexity · Computer Science 2026-03-10 Nikolai Chukhin , Alexander S. Kulikov , Ivan Mihajlin , Arina Smirnova

For a finite group $G$ and an integer $r\ge 2$ let $$ P_r(G):=\frac{|Hom(\mathbb Z^r,G)|}{|G|^r}, $$ where $\Hom(\mathbb Z^r,G)$ is the set of pairwise commuting $r$-tuples in $G$. This paper studies rigidity and extremal behavior of the…

Group Theory · Mathematics 2026-05-19 Vadim E Levit , Robert Shwartz

We study the bar-and-joint frameworks in $\mathbb{R}^2$ such that some vertices are constrained to lie on some lines. The generic rigidity of such frameworks is characterised by Streinu and Theran (2010). Katoh and Tanigawa (2013) remarked…

Combinatorics · Mathematics 2022-12-09 Hakan Guler

Let $ACC \circ THR$ be the class of constant-depth circuits comprised of AND, OR, and MOD$m$ gates (for some constant $m > 1$), with a bottom layer of gates computing arbitrary linear threshold functions. This class of circuits can be seen…

Computational Complexity · Computer Science 2014-01-13 Ryan Williams

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

We obtain lower tail estimates for the smallest singular value of random matrices with independent but non-identically distributed entries. Specifically, we consider $n\times n$ matrices with complex entries of the form \[ M = A\circ X + B…

Probability · Mathematics 2018-05-21 Nicholas A. Cook

Low-rank approximation of a matrix by means of structured random sampling has been consistently efficient in its extensive empirical studies around the globe, but adequate formal support for this empirical phenomenon has been missing so…

Numerical Analysis · Mathematics 2016-07-21 Victor Pan , John Svadlenka , Liang Zhao

We study the rank of complex sparse matrices in which the supports of different columns have small intersections. The rank of these matrices, called design matrices, was the focus of a recent work by Barak et. al. (BDWY11) in which they…

Combinatorics · Mathematics 2012-11-05 Zeev Dvir , Shubhangi Saraf , Avi Wigderson

The approximate stabilizer rank of a quantum state is the minimum number of terms in any approximate decomposition of that state into stabilizer states. Bravyi and Gosset showed that the approximate stabilizer rank of a so-called "magic"…

Quantum Physics · Physics 2024-04-02 Saeed Mehraban , Mehrdad Tahmasbi

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

Numerical Analysis · Mathematics 2014-08-12 Ming Gu