English
Related papers

Related papers: On Solving Linear Systems in Sublinear Time

200 papers

We present a new class of preconditioned iterative methods for solving linear systems of the form $Ax = b$. Our methods are based on constructing a low-rank Nystr\"om approximation to $A$ using sparse random matrix sketching. This…

Data Structures and Algorithms · Computer Science 2025-04-14 Michał Dereziński , Christopher Musco , Jiaming Yang

A fundamental problem arising in many applications in Web science and social network analysis is, given an arbitrary approximation factor $c>1$, to output a set $S$ of nodes that with high probability contains all nodes of PageRank at least…

Data Structures and Algorithms · Computer Science 2015-03-20 Christian Borgs , Michael Brautbar , Jennifer Chayes , Shang-Hua Teng

In this paper we provide nearly linear time algorithms for several problems closely associated with the classic Perron-Frobenius theorem, including computing Perron vectors, i.e. entrywise non-negative eigenvectors of non-negative matrices,…

Data Structures and Algorithms · Computer Science 2018-10-05 AmirMahdi Ahmadinejad , Arun Jambulapati , Amin Saberi , Aaron Sidford

Understanding the singular value spectrum of a matrix $A \in \mathbb{R}^{n \times n}$ is a fundamental task in countless applications. In matrix multiplication time, it is possible to perform a full SVD and directly compute the singular…

Data Structures and Algorithms · Computer Science 2019-01-04 Cameron Musco , Praneeth Netrapalli , Aaron Sidford , Shashanka Ubaru , David P. Woodruff

We present an algorithm for approximating semidefinite programs with running time that is sublinear in the number of entries in the semidefinite instance. We also present lower bounds that show our algorithm to have a nearly optimal running…

Optimization and Control · Mathematics 2012-08-28 Dan Garber , Elad Hazan

We study the problem of solving semidefinite programs (SDP) in the streaming model. Specifically, $m$ constraint matrices and a target matrix $C$, all of size $n\times n$ together with a vector $b\in \mathbb{R}^m$ are streamed to us…

Data Structures and Algorithms · Computer Science 2023-09-12 Zhao Song , Mingquan Ye , Lichen Zhang

Let $\mathbf{P}=\{ p_1, p_2, \ldots p_n \}$ and $\mathbf{Q} = \{ q_1, q_2 \ldots q_m \}$ be two point sets in an arbitrary metric space. Let $\mathbf{A}$ represent the $m\times n$ pairwise distance matrix with $\mathbf{A}_{i,j} = d(p_i,…

Data Structures and Algorithms · Computer Science 2018-09-20 Ainesh Bakshi , David P. Woodruff

In this paper, we consider the following graph partitioning problem: The input is an undirected graph $G=(V,E),$ a balance parameter $b \in (0,1/2]$ and a target conductance value $\gamma \in (0,1).$ The output is a cut which, if non-empty,…

Data Structures and Algorithms · Computer Science 2010-10-21 Lorenzo Orecchia , Nisheeth K. Vishnoi

We present a distributed asynchronous algorithm for approximating a single component of the solution to a system of linear equations $Ax = b$, where $A$ is a positive definite real matrix, and $b \in \mathbb{R}^n$. This is equivalent to…

Data Structures and Algorithms · Computer Science 2019-01-23 Asuman Ozdaglar , Devavrat Shah , Christina Lee Yu

Sublinear time algorithms for approximating maximum matching size have long been studied. Much of the progress over the last two decades on this problem has been on the algorithmic side. For instance, an algorithm of Behnezhad [FOCS'21]…

Data Structures and Algorithms · Computer Science 2022-11-30 Soheil Behnezhad , Mohammad Roghani , Aviad Rubinstein

In the Subset Sum problem we are given a set of $n$ positive integers $X$ and a target $t$ and are asked whether some subset of $X$ sums to $t$. Natural parameters for this problem that have been studied in the literature are $n$ and $t$ as…

Data Structures and Algorithms · Computer Science 2020-10-20 Karl Bringmann , Philip Wellnitz

We present a new sublinear time algorithm for approximating the spectral density (eigenvalue distribution) of an $n\times n$ normalized graph adjacency or Laplacian matrix. The algorithm recovers the spectrum up to $\epsilon$ accuracy in…

Data Structures and Algorithms · Computer Science 2022-04-18 Vladimir Braverman , Aditya Krishnan , Christopher Musco

We study sublinear time algorithms for estimating the size of maximum matching. After a long line of research, the problem was finally settled by Behnezhad [FOCS'22], in the regime where one is willing to pay an approximation factor of $2$.…

Data Structures and Algorithms · Computer Science 2023-04-28 Sayan Bhattacharya , Peter Kiss , Thatchaphol Saranurak

We present a novel algorithm attaining excessively fast, the sought solution of linear systems of equations. The algorithm is short in its basic formulation and, by definition, vectorized, while the memory allocation demands are trivial,…

Machine Learning · Computer Science 2023-09-26 Nikolaos P. Bakas

In the realm of big data and machine learning, data-parallel, distributed stochastic algorithms have drawn significant attention in the present days.~While the synchronous versions of these algorithms are well understood in terms of their…

Optimization and Control · Mathematics 2020-04-07 Atal Narayan Sahu , Aritra Dutta , Aashutosh Tiwari , Peter Richtárik

We develop a general framework for finding approximately-optimal preconditioners for solving linear systems. Leveraging this framework we obtain improved runtimes for fundamental preconditioning and linear system solving problems including…

Data Structures and Algorithms · Computer Science 2023-10-30 Arun Jambulapati , Jerry Li , Christopher Musco , Kirankumar Shiragur , Aaron Sidford , Kevin Tian

Semidefinite programs (SDPs) are a fundamental class of optimization problems with important recent applications in approximation algorithms, quantum complexity, robust learning, algorithmic rounding, and adversarial deep learning. This…

Data Structures and Algorithms · Computer Science 2020-09-23 Haotian Jiang , Tarun Kathuria , Yin Tat Lee , Swati Padmanabhan , Zhao Song

Motivated by the philosophy and phenomenal success of compressed sensing, the problem of reconstructing a matrix from a sampling of its entries has attracted much attention recently. Such a problem can be viewed as an information-theoretic…

Information Theory · Computer Science 2009-05-15 Zhisu Zhu , Anthony Man-Cho So , Yinyu Ye

We consider linear systems arising from the use of the finite element method for solving scalar linear elliptic problems. Our main result is that these linear systems, which are symmetric and positive semidefinite, are well approximated by…

Numerical Analysis · Mathematics 2025-10-20 Erik Boman , Bruce Hendrickson , Stephen Vavasis

We introduce a novel algorithm for approximating the logarithm of the determinant of a symmetric positive definite (SPD) matrix. The algorithm is randomized and approximates the traces of a small number of matrix powers of a specially…

Data Structures and Algorithms · Computer Science 2016-09-01 Christos Boutsidis , Petros Drineas , Prabhanjan Kambadur , Eugenia-Maria Kontopoulou , Anastasios Zouzias