English
Related papers

Related papers: Sampling from large matrices: an approach through …

200 papers

Structural matrix-variate observations routinely arise in diverse fields such as multi-layer network analysis and brain image clustering. While data of this type have been extensively investigated with fruitful outcomes being delivered, the…

Statistics Theory · Mathematics 2022-01-25 Zhongyuan Lyu , Dong Xia

We study the problem of approximating the eigenspectrum of a symmetric matrix $\mathbf A \in \mathbb{R}^{n \times n}$ with bounded entries (i.e., $\|\mathbf A\|_{\infty} \leq 1$). We present a simple sublinear time algorithm that…

Data Structures and Algorithms · Computer Science 2022-07-25 Rajarshi Bhattacharjee , Gregory Dexter , Petros Drineas , Cameron Musco , Archan Ray

A random matrix is likely to be well conditioned, and motivated by this well known property we employ random matrix multipliers to advance some fundamental matrix computations. This includes numerical stabilization of Gaussian elimination…

Numerical Analysis · Mathematics 2012-12-27 Victor Y. Pan , Guoliang Qian

We introduce and study the problem of consistent low-rank approximation, in which rows of an input matrix $\mathbf{A}\in\mathbb{R}^{n\times d}$ arrive sequentially and the goal is to provide a sequence of subspaces that well-approximate the…

Data Structures and Algorithms · Computer Science 2026-03-03 David P. Woodruff , Samson Zhou

We consider the problem of sampling and approximately counting an arbitrary given motif $H$ in a graph $G$, where access to $G$ is given via queries: degree, neighbor, and pair, as well as uniform edge sample queries. Previous algorithms…

Data Structures and Algorithms · Computer Science 2021-07-20 Amartya Shankha Biswas , Talya Eden , Ronitt Rubinfeld

Matrix rank minimizing subject to affine constraints arises in many application areas, ranging from signal processing to machine learning. Nuclear norm is a convex relaxation for this problem which can recover the rank exactly under some…

Computer Vision and Pattern Recognition · Computer Science 2015-08-20 Zhao Kang , Chong Peng , Qiang Cheng

We consider the problem of determining the optimal block (or subsample) size for a spatial subsampling method for spatial processes observed on regular grids. We derive expansions for the mean square error of the subsampling variance…

Statistics Theory · Mathematics 2007-06-13 Daniel J. Nordman , Soumendra N. Lahiri

Let $A$ be an $n\times n$ random matrix whose entries are i.i.d. with mean $0$ and variance $1$. We present a deterministic polynomial time algorithm which, with probability at least $1-2\exp(-\Omega(\epsilon n))$ in the choice of $A$,…

Probability · Mathematics 2020-12-02 Vishesh Jain , Ashwin Sah , Mehtaab Sawhney

A randomized algorithm for computing a compressed representation of a given rank-structured matrix $A \in \mathbb{R}^{N\times N}$ is presented. The algorithm interacts with $A$ only through its action on vectors. Specifically, it draws two…

Numerical Analysis · Mathematics 2024-06-25 James Levitt , Per-Gunnar Martinsson

This paper studies the problem of recovering a low-rank matrix from several noisy random linear measurements. We consider the setting where the rank of the ground-truth matrix is unknown a priori and use an objective function built from a…

Optimization and Control · Mathematics 2025-07-29 Lijun Ding , Zhen Qin , Liwei Jiang , Jinxin Zhou , Zhihui Zhu

We consider the twin problems of estimating the effective rank and the Schatten norms $\|{\bf A}\|_{s}$ of a rectangular $p\times q$ matrix ${\bf A}$ from noisy observations. When $s$ is an even integer, we introduce a polynomial-time…

Statistics Theory · Mathematics 2021-11-29 Solène Thépaut , Nicolas Verzelen

We present novel techniques for analyzing the problem of low-rank matrix recovery. The methods are both considerably simpler and more general than previous approaches. It is shown that an unknown (n x n) matrix of rank r can be efficiently…

Information Theory · Computer Science 2011-03-22 David Gross

This paper is devoted to two different two-time-scale stochastic approximation algorithms for superquantile estimation. We shall investigate the asymptotic behavior of a Robbins-Monro estimator and its convexified version. Our main…

Statistics Theory · Mathematics 2020-07-30 Bernard Bercu , Manon Costa , Sébastien Gadat

We study the maximum-average submatrix problem, in which given an $N \times N$ matrix $J$ one needs to find the $k \times k$ submatrix with the largest average of entries. We study the problem for random matrices $J$ whose entries are…

Disordered Systems and Neural Networks · Physics 2024-01-24 Vittorio Erba , Florent Krzakala , Rodrigo Pérez , Lenka Zdeborová

We study randomized algorithms for constrained optimization, in abstract frameworks that include, in strictly increasing generality: convex programming; LP-type problems; violator spaces; and a setting we introduce, consistent spaces. Such…

Computational Geometry · Computer Science 2019-06-04 Kenneth L. Clarkson , Bernd Gärtner , Johannes Lengler , May Szedlak

Low-rank approximation of kernels is a fundamental mathematical problem with widespread algorithmic applications. Often the kernel is restricted to an algebraic variety, e.g., in problems involving sparse or low-rank data. We show that…

Machine Learning · Computer Science 2023-10-02 Jason M. Altschuler , Pablo A. Parrilo

Inspired by the quantum computing algorithms for Linear Algebra problems [HHL,TaShma] we study how the simulation on a classical computer of this type of "Phase Estimation algorithms" performs when we apply it to solve the Eigen-Problem of…

Data Structures and Algorithms · Computer Science 2017-04-07 Michael Ben-Or , Lior Eldar

In recent years, bootstrap methods have drawn attention for their ability to approximate the laws of "max statistics" in high-dimensional problems. A leading example of such a statistic is the coordinate-wise maximum of a sample average of…

Statistics Theory · Mathematics 2019-07-23 Miles E. Lopes , Zhenhua Lin , Hans-Georg Mueller

We consider the problem of reconstructing a rank-$k$ $n \times n$ matrix $M$ from a sampling of its entries. Under a certain incoherence assumption on $M$ and for the case when both the rank and the condition number of $M$ are bounded, it…

Machine Learning · Statistics 2017-08-23 David Gamarnik , Quan Li , Hongyi Zhang

We propose a proximal point algorithm to solve LAROS problem, that is the problem of finding a "large approximately rank-one submatrix". This LAROS problem is used to sequentially extract features in data. We also develop a new stopping…

Optimization and Control · Mathematics 2011-08-05 Xuan Vinh Doan , Kim-Chuan Toh , Stephen Vavasis