English
Related papers

Related papers: On the Rank of Random Sparse Matrices

200 papers

Motivated by the popularity of stochastic rounding in the context of machine learning and the training of large-scale deep neural network models, we consider stochastic nearness rounding of real matrices $\mathbf{A}$ with many more rows…

Machine Learning · Computer Science 2024-12-10 Gregory Dexter , Christos Boutsikas , Linkai Ma , Ilse C. F. Ipsen , Petros Drineas

This paper considers the problem of estimating a low-rank matrix from the observation of all or a subset of its entries in the presence of Poisson noise. When we observe all entries, this is a problem of matrix denoising; when we observe…

Machine Learning · Statistics 2024-04-22 Andrew D. McRae , Mark A. Davenport

We discuss probabilistic models of random covariance structures defined by distributions over sparse eigenmatrices. The decomposition of orthogonal matrices in terms of Givens rotations defines a natural, interpretable framework for…

Methodology · Statistics 2022-06-07 Andrew J. Cron , Mike West

The matrix completion problem aims to reconstruct a low-rank matrix based on a revealed set of possibly noisy entries. Prior works consider completing the entire matrix with generalization error guarantees. However, the completion accuracy…

Machine Learning · Computer Science 2023-12-19 Elad Hazan , Adam Tauman Kalai , Varun Kanade , Clara Mohri , Y. Jennifer Sun

In this paper, we show that the low rank matrix completion problem can be reduced to the problem of finding the rank of a certain tensor.

Optimization and Control · Mathematics 2013-07-24 Harm Derksen

Let $M_n$ be a class of symmetric sparse random matrices, with independent entries $M_{ij} = \delta_{ij} \xi_{ij}$ for $i \leq j$. $\delta_{ij}$ are i.i.d. Bernoulli random variables taking the value $1$ with probability $p \geq…

Probability · Mathematics 2018-02-20 Kyle Luh , Van Vu

We consider tensor factorizations based on sparse measurements of the components of relatively high rank tensors. The measurements are designed in a way that the underlying graph of interactions is a random graph. The setup will be useful…

Machine Learning · Statistics 2026-04-15 Angelo Giorgio Cavaliere , Riki Nagasawa , Shuta Yokoi , Tomoyuki Obuchi , Hajime Yoshino

We consider the set of $n\times n$ matrices with rational entries having numerator and denominator of size at most $H$ and obtain upper and lower bounds on the number of such matrices of a given rank and then apply them to count such…

Number Theory · Mathematics 2026-03-04 Muhammad Afifurrahman , Vivian Kuperberg , Alina Ostafe , Igor E. Shparlinski

The warping matrix has been defined for knot projections and knot diagrams by using warping degrees. In particular, the warping matrix of a knot diagram represents the knot diagram uniquely. In this paper we show that the rank of the…

Geometric Topology · Mathematics 2015-08-26 Taira Akiyama , Ayaka Shimizu , Ryohei Watanabe

A Random SubMatrix method (RSM) is proposed to calculate the low-rank decomposition of large-scale matrices with known entry percentage \rho. RSM is very fast as the floating-point operations (flops) required are compared favorably with the…

Numerical Analysis · Computer Science 2015-10-28 Yiguang Liu

Matrix approximation is a common tool in machine learning for building accurate prediction models for recommendation systems, text mining, and computer vision. A prevalent assumption in constructing matrix approximations is that the…

Machine Learning · Computer Science 2013-01-16 Joonseok Lee , Seungyeon Kim , Guy Lebanon , Yoram Singer

We revisit the probabilistic construction of sparse random matrices where each column has a fixed number of nonzeros whose row indices are drawn uniformly at random. These matrices have a one-to-one correspondence with the adjacency…

Information Theory · Computer Science 2013-07-25 Bubacarr Bah , Jared Tanner

Despite the popularity of low-rank matrix completion, the majority of its theory has been developed under the assumption of random observation patterns, whereas very little is known about the practically relevant case of non-random…

Machine Learning · Computer Science 2023-02-24 Manolis C. Tsakiris

We study a regression model with a huge number of interacting variables. We consider a specific approximation of the regression function under two ssumptions: (i) there exists a sparse representation of the regression function in a…

Statistics Theory · Mathematics 2009-09-29 Peter J. Bickel , Ya'acov Ritov , Alexander B. Tsybakov

A new necessary and sufficient condition for the existence of minor left prime factorizations of multivariate polynomial matrices without full row rank is presented. The key idea is to establish a relationship between a matrix and its full…

Symbolic Computation · Computer Science 2020-10-15 Dong Lu , Dingkang Wang , Fanghui Xiao

Patterned random matrices such as the reverse circulant, the symmetric circulant, the Toeplitz and the Hankel matrices and their almost sure limiting spectral distribution (LSD), have attracted much attention. Under the assumption that the…

Probability · Mathematics 2022-03-14 Arup Bose , Koushik Saha , Priyanka Sen

We consider the high-dimensional inference problem where the signal is a low-rank symmetric matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large…

Probability · Mathematics 2017-03-31 Marc Lelarge , Léo Miolane

The ranking problem is to order a collection of units by some unobserved parameter, based on observations from the associated distribution. This problem arises naturally in a number of contexts, such as business, where we may want to rank…

Statistics Theory · Mathematics 2019-09-04 Toby Kenney

Low rank inference on matrices is widely conducted by optimizing a cost function augmented with a penalty proportional to the nuclear norm $\Vert \cdot \Vert_*$. However, despite the assortment of computational methods for such problems,…

Machine Learning · Statistics 2025-10-08 Simon Segert , Nathan Wycoff

Theoretical analysis of biological and artificial neural networks e.g. modelling of synaptic or weight matrices necessitate consideration of the generic real-asymmetric matrix ensembles, those with varying order of matrix elements e.g. a…

Disordered Systems and Neural Networks · Physics 2025-09-15 Ratul Dutta , Pragya Shukla